download free 30 days trial version buy Bucket Explorer

Cannot list versions above 1000

On-line support for Bucket Explorer for Amazon S3

Cannot list versions above 1000

Postby jan.vlcinsky » Wed Apr 28, 2010 7:57 pm

Hi
I store some updated data each minute and have already couple of thousands of versions.
Bucket Explorer does help a lot with listing and downloading versions, if they fit to the first page of versions (by default limited to 1000).
However, if I click Next 1000 button, it does not change versions listed.
Consulting BucketExplorerError.log file I found

28 IV 2010 21:34:05,843 ERROR vj Error : BucketExplorerMain: Exception while adding Version Error - String index out of range: 31 Stacktracejava.lang.StringIndexOutOfBoundsException: String index out of range: 31
at java.lang.String.substring(Unknown Source)
at com.bucketexplorer.main.apk.a(Unknown Source)
at com.bucketexplorer.main.aei.run(Unknown Source)

It seems there is a bug.

Is there any workaround for this? I would appreciate any trick, otherwise I have to develop my own utility for listing and fetching older data.

Thanks for great product anyway.

Jan Vlčinský
jan.vlcinsky
 
Posts: 13
Joined: Thu Apr 22, 2010 8:29 pm

Re: Cannot list versions above 1000

Postby Rajkumari » Thu Apr 29, 2010 10:50 am

28 IV 2010 21:34:05,843 ERROR vj Error : BucketExplorerMain: Exception while adding Version Error - String index out of range: 31 Stacktracejava.lang.StringIndexOutOfBoundsException: String index out of range: 31
at java.lang.String.substring(Unknown Source)
at com.bucketexplorer.main.apk.a(Unknown Source)
at com.bucketexplorer.main.aei.run(Unknown Source)

It seems there is a bug.


yes its a bug but its not related to version listing ,we have resolved this bug you can download new patch of Bucket Explorer(version : 2010.04.00.01) from :
http://www.bucketexplorer.com/be-download.html


I store some updated data each minute and have already couple of thousands of versions.
Bucket Explorer does help a lot with listing and downloading versions, if they fit to the first page of versions (by default limited to 1000).
However, if I click Next 1000 button, it does not change versions listed.


Can you check version listing of your bucket with newer version ( 2010.04.00.01),before start work Set Debug on using Tools -> Enable Debug Logging ,now perform Version listing operation .check versions listed above 1000 or not , if not then please upload Bucket Explorer log files .
you can open logs folder from Option Help->open logs.
Here you will find Bucket Explorer Logs files.

upload your logs here:
http://www.bucketexplorer.com/upload.aspx\


Thanks!
Rajkumari
Rajkumari
 
Posts: 84
Joined: Fri Oct 23, 2009 11:49 am

Re: Cannot list versions above 1000

Postby jan.vlcinsky » Thu Apr 29, 2010 7:03 pm

Hi Rajkumari
Updated to version Bucket Explorer(version : 2010.04.00.01)
The String index out of range is gone, as you expected.
Testing Next 1000 shows that the button still does not work properly.
I created log files as you asked for and uploaded file Next1000VersionsLogs.zip to the url you specified.
Tomorrow (I hope) I will collect access logs from AWS for those requests and provide it too.
jan.vlcinsky
 
Posts: 13
Joined: Thu Apr 22, 2010 8:29 pm

Re: Cannot list versions above 1000

Postby jan.vlcinsky » Thu Apr 29, 2010 7:46 pm

I uploaded AWS S3 log records (from earlier dates, but from the same scenario).
See Next1000VersionsAwsS3Logs.zip
Jan
jan.vlcinsky
 
Posts: 13
Joined: Thu Apr 22, 2010 8:29 pm

Re: Cannot list versions above 1000

Postby jan.vlcinsky » Thu Apr 29, 2010 10:57 pm

I just uploaded Next1000VersionsAWSS3LogsFromBucketExplorerTest.zip with AWS S3 records just from the time the test was done.

Jan
jan.vlcinsky
 
Posts: 13
Joined: Thu Apr 22, 2010 8:29 pm

Re: Cannot list versions above 1000

Postby Rajkumari » Fri Apr 30, 2010 4:45 am

Thanks ,

We are looking forward to your logs.

Thanks !
Rajkumari
Rajkumari
 
Posts: 84
Joined: Fri Oct 23, 2009 11:49 am

Re: Cannot list versions above 1000

Postby jan.vlcinsky » Fri Apr 30, 2010 8:50 am

All the logs are already there (uploaded)
  • Next1000VersionsAWSS3LogsFromBucketExplorerTest.zip
  • Next1000VersionsLogs.zip
They match in time and so far I have nothing more to provide.

Jan
jan.vlcinsky
 
Posts: 13
Joined: Thu Apr 22, 2010 8:29 pm

Re: Cannot list versions above 1000

Postby Rajkumari » Fri Apr 30, 2010 2:02 pm

Hello jen,

We have got your logs and after review you uploaded logs, we found that you are getting internal server in response from amazon. we are also working on that..

Till that...Can you do this-
As you said that your are able to list first 1000 object successfully...
So can you please check it for more then 1000 pagination size
For that follows these steps :-
1. Run Bucket Explorer as usual
2. Go to Tools->Prefrences and set page size more then 1000(5000 or number of object you want to list in first time )
3. Select that bucket.
4. select same object/file and list version using right click.
5. wait for complete version listing according to page size. wait for while till list completed not shown in status.
Then let us know that are you able to list that all version of perticular file or not that you did earlier.

Thanks!
Rajkumari
Rajkumari
 
Posts: 84
Joined: Fri Oct 23, 2009 11:49 am

Re: Cannot list versions above 1000

Postby jan.vlcinsky » Fri Apr 30, 2010 2:44 pm

Hello
I tried this already before and it seems, that given property for number of items on one page affects only number of files in one "directory" but not list of versions.

I changed given number to 1500 and opened folder with log files. As there are more then 3000 separate log files (not versions but files) the listing went till it reached 1501 items.

Then I tried list all versions of file region/pl/CustomerServiceReady.xml and the listing showed just 1000 items and not more.

So it seems that given settings does not apply to list of versions.

Jan
jan.vlcinsky
 
Posts: 13
Joined: Thu Apr 22, 2010 8:29 pm

Re: Cannot list versions above 1000

Postby Rajkumari » Mon May 03, 2010 10:25 am

Hello Jan,

We found the cause of this bug and soon we will provide you a fixed version of Bucket Explorer.

once again thanks for reporting this issue .



Thanks !
Rajkumari
Rajkumari
 
Posts: 84
Joined: Fri Oct 23, 2009 11:49 am

Next

Return to Bucket Explorer for Amazon S3 - Support Forum



cron