I wanted to download more than just the data in the API (i.e. I also wanted data from a sensor going back years). To this end I wrote a python module that uses yours, but also accesses the s3 buckets where openAQ keeps its archive. It works... sort of. But each file is about 100Mb for one day, and the sensors are jumbled about inside them, so I find I have to search the whole file for each one. I'm just writing some code now that tries to deal with that, as the same sensor seems to be fairly evenly spaced over the file, but it's not ideal. Just wondering if you've any ideas? Maybe the openAQ people could host the files in a different way (e.g. order the files by sensor first, then by time?)...Thanks for the great module.
I wanted to download more than just the data in the API (i.e. I also wanted data from a sensor going back years). To this end I wrote a python module that uses yours, but also accesses the s3 buckets where openAQ keeps its archive. It works... sort of. But each file is about 100Mb for one day, and the sensors are jumbled about inside them, so I find I have to search the whole file for each one. I'm just writing some code now that tries to deal with that, as the same sensor seems to be fairly evenly spaced over the file, but it's not ideal. Just wondering if you've any ideas? Maybe the openAQ people could host the files in a different way (e.g. order the files by sensor first, then by time?)...Thanks for the great module.