Skip to content

not able to export when data is more than 1000 rows #52

Description

@jeevitesh

Hi,
I'm using hrider 1.0.82 connected to hbase. I have rows numbering 1064, if i try to export it is exporting only 64 rows. I have checked the config(global properties) and increased writesize but still it not able to export more than 1000 rows

Activity

  1. icher-g commented on Aug 27, 2014

    @icher-g

    Hi,

    I will check this later but meanwhile why do you need export? What do you try to accomplish?
    You can change the rows number to more than 1064 before populating the table and click open in external editor. It will open in EXCEL by default and you will have all the rows exported in the comma delimited format I think.

  2. jeevitesh commented on Aug 27, 2014

    @jeevitesh
    Author

    thanks for the replay...
    I need to export the data because I need to take backup...
    Or could that be size issue normally It will be around 100mb of data for
    1000rows...
    so In global properties file i increased writeSize but no change in the
    behaviour
    And not able to understand why i need to create 1064 rows before populating
    thanks a lot..

    On Wed, Aug 27, 2014 at 6:16 PM, Igor Cher notifications@github.com wrote:

    Hi,

    I will check this later but meanwhile why do you need export? What do you
    try to accomplish?
    You can change the rows number to more than 1064 before populating the
    table and click open in external editor. It will open in EXCEL by default
    and you will have all the rows exported in the comma delimited format I
    think.

    —
    Reply to this email directly or view it on GitHub
    #52 (comment).

  3. icher-g commented on Aug 28, 2014

    @icher-g

    What version of the h-rider do you use?
    In the export dialog there are two options of export: as an .hfile or text delimited. The first option should work no matter how big your table. Keep in mind that to back up big table will take time because all the rows are being transferred into your local machine. You can also consider using hbase feature of backing up the tables. It is a map/reduce job that you can invoke from the command line.

  4. jeevitesh commented on Aug 28, 2014

    @jeevitesh
    Author

    hi ignor,
    thanks for the replay...
    I'll consider those options please correct if i'm wrong track...
    I got this two set of java program to export hbase data to csv and import
    data.* so is this is the best option or is there any better option.*
    http://www.mccarroll.net/snippets/hbaseload/HBaseExporter.java
    http://hbase.apache.org/xref/org/apache/hadoop/hbase/mapreduce/SampleUploader.html
    thanks
    jeevitesh

    On Thu, Aug 28, 2014 at 12:51 PM, Igor Cher notifications@github.com
    wrote:

    What version of the h-rider do you use?
    In the export dialog there are two options of export: as an .hfile or text
    delimited. The first option should work no matter how big your table. Keep
    in mind that to back up big table will take time because all the rows are
    being transferred into your local machine. You can also consider using
    hbase feature of backing up the tables. It is a map/reduce job that you can
    invoke from the command line.

    —
    Reply to this email directly or view it on GitHub
    #52 (comment).

  5. jeevitesh commented on Aug 28, 2014

    @jeevitesh
    Author

    hi,
    tried both version h-rider-1.0.8.3-hbase-0.94.1
    and h-rider-1.0.8.2-hbase-0.94.1 both having same issues not able to export

    On Thu, Aug 28, 2014 at 1:00 PM, jeevi tesh jeevitesh.ms@gmail.com wrote:

    hi ignor,
    thanks for the replay...
    I'll consider those options please correct if i'm wrong track...
    I got this two set of java program to export hbase data to csv and import
    data.* so is this is the best option or is there any better option.*
    http://www.mccarroll.net/snippets/hbaseload/HBaseExporter.java

    http://hbase.apache.org/xref/org/apache/hadoop/hbase/mapreduce/SampleUploader.html
    thanks
    jeevitesh

    On Thu, Aug 28, 2014 at 12:51 PM, Igor Cher notifications@github.com
    wrote:

    What version of the h-rider do you use?
    In the export dialog there are two options of export: as an .hfile or
    text delimited. The first option should work no matter how big your table.
    Keep in mind that to back up big table will take time because all the rows
    are being transferred into your local machine. You can also consider using
    hbase feature of backing up the tables. It is a map/reduce job that you can
    invoke from the command line.

    —
    Reply to this email directly or view it on GitHub
    #52 (comment).

  6. icher-g commented on Aug 31, 2014

    @icher-g

    Hi,
    There is a built in support for import/export tables from hbase.
    You can try them: http://hbase.apache.org/book.html#export

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions