Skip to content

NickCrews/apoc-data

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

20 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

APOC Data

Data from the Alaska Public Offices Commission.

This scrapes the CSV files from the APOC website once a day and uploads them to this repo's releases.

Manual

Browse from this repo's releases.

Python

pip install apoc-data and then

from apoc_data.download import download

download(
    release="latest",
    filename="debt.csv",
    destination="apoc_debt.csv",
)

Shell

You can download these CSVs using the direct URLs from the releases page using curl, pandas, ibis, whatever!

curl -L https://github.com/NickCrews/apoc-data/releases/download/20240716-025636/candidate_registration.csv > candidate_registration.csv

or we have a tiny python script that makes this a little nicer, eg get the latest release, choose the download directory, etc. Read the script for more info.

curl -s https://raw.githubusercontent.com/NickCrews/apoc-data/main/src/apoc_data/download.py | python - --release latest

Dev Notes

pdm install
playwright install chromium

scrape:

python -m apoc_data.scrape --directory downloads --no-headless