[atlas] Issues downloading large result files
- Previous message (by thread): [atlas] Issues downloading large result files
- Next message (by thread): [atlas] Issues downloading large result files
Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]
Robert Kisteleki
robert at ripe.net
Thu Jul 20 15:52:02 CEST 2023
Hello, We've seen periods where someone was downloading 10-30GB result blobs (years' worth of results), multiple downloads in parallel, and while it stressed the service, it worked for the most part. This *could* work, but it's suboptimal. My advice would be to download in chunks (perhaps daily or weekly ones, depending on how much data that is). You can do this via the start=TIMESTAMP and stop=TIMESTAMP parameters, eg. https://atlas.ripe.net/api/v2/measurements/<ID>/results/?start=1688947200&stop=1689033599&format=txt Hope this helps, Robert On 2023-07-19 11:48, Ana wrote: > Hi everyone, > > I'm seeing something very strange when trying to download the result > files for some large measurements. > > The download is a different size each time (sometimes 1.4GB, then 3.2GB, > then back to 1 GB again) and checking the end of the file I can always > see it's not complete as it stops in the middle of a measurement, > closing brackets aren't there etc. > > I guess this is because of the size of the file, not sure if there's > some sort of limit on RIPE Atlas? > > If anyone here has seen anything like this or has any advice on how to > fully download the result that would be much appreciated! > > > Thank you, > > Ana > >
- Previous message (by thread): [atlas] Issues downloading large result files
- Next message (by thread): [atlas] Issues downloading large result files
Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]