mirror of
https://github.com/DOI-DO/j40-cejst-2.git
synced 2025-02-23 10:04:18 -08:00
67c73dde2a
* reorg
* added configuration management; initial click cmds
* reset dirs completed
* major modularization effort
* prepping mbtiles
* first round of PR review updates
* round 2 of feedback review
* checkpoint
* habemus dockerfile 🎉
* updated dock-er-compose with long running container
* census generation works
* logging working
* updated README
* updated README
* last small update to README
* added instructions for log visualization
* census etl update for reusable fips module
* ejscreem etl updated
* further modularization
* score modularization
* tmp cleanup
71 lines
3.2 KiB
Markdown
71 lines
3.2 KiB
Markdown
# Justice 40 Score application
|
|
|
|
## Running using Docker
|
|
|
|
We use Docker to install the necessary libraries in a container that can be run in any operating system.
|
|
|
|
To build the docker container the first time, make sure you're in the root directory of the repository and run `docker-compose build`
|
|
|
|
Then run commands, opening a new terminal window or tab:
|
|
|
|
- Get help: `docker run --rm -it j40_score /bin/sh -c "python3 application.py" python3 application.py --help"`
|
|
- Clean up the data directories: `docker run --rm -it j40_score /bin/sh -c "python3 application.py data-cleanup"`
|
|
- Generate census data: `docker run --rm -it j40_score /bin/sh -c "python3 application.py census-data-download"`
|
|
|
|
## Log visualization
|
|
|
|
If you want to visualize logs, the following temporary workaround can be used:
|
|
|
|
- Run `docker-compose up` on the root of the repo
|
|
- Open a new tab on your terminal
|
|
- Then run any command for the application using this format: `docker exec j40_score_1 python3 application.py [command]`
|
|
|
|
## Local development
|
|
|
|
You can run the Python code locally to develop, using Poetry. However, to generate the census data you will need the [GDAL library](https://github.com/OSGeo/gdal) installed locally. Also to generate tiles for a local map, you will need [Mapbox tippeanoe](https://github.com/mapbox/tippecanoe)
|
|
|
|
- Start a terminal
|
|
- Make sure you have Python 3.9 installed: `python -V` or `python3 -V`
|
|
- We use [Poetry](https://python-poetry.org/) for managing dependencies and building the application. Please follow the instructions on their site to download.
|
|
- Install Poetry requirements with `poetry install`
|
|
|
|
### Downloading Census Block Groups GeoJSON and Generating CBG CSVs
|
|
|
|
- Make sure you have Docker running in your machine
|
|
- Start a terminal
|
|
- Change to this directory (i.e. `cd score`)
|
|
- If you want to clear out all data and tiles from all directories, you can run: `poetry run python application.py data-cleanup`.
|
|
- Then run `poetry run python application.py census-data-download`
|
|
Note: Census files are not kept in the repository and the download directories are ignored by Git
|
|
|
|
### Generating mbtiles
|
|
|
|
- TBD
|
|
|
|
### Serve the map locally
|
|
|
|
- Start a terminal
|
|
- Change to this directory (i.e. `cd score`)
|
|
- Run: `docker run --rm -it -v ${PWD}/data/tiles:/data -p 8080:80 maptiler/tileserver-gl`
|
|
|
|
### Running Jupyter notebooks
|
|
|
|
- Start a terminal
|
|
- Change to this directory (i.e. `cd score`)
|
|
- Run `poetry run jupyter notebook`. Your browser should open with a Jupyter Notebook tab
|
|
|
|
### Activating variable-enabled Markdown for Jupyter notebooks
|
|
|
|
- Change to this directory (i.e. `cd score`)
|
|
- Activate a Poetry Shell (see above)
|
|
- Run `jupyter contrib nbextension install --user`
|
|
- Run `jupyter nbextension enable python-markdown/main`
|
|
- Make sure you've loaded the Jupyter notebook in a "Trusted" state. (See button near
|
|
top right of Notebook screen.)
|
|
|
|
For more information, see [nbextensions docs](https://jupyter-contrib-nbextensions.readthedocs.io/en/latest/install.html) and
|
|
see [python-markdown docs](https://github.com/ipython-contrib/jupyter_contrib_nbextensions/tree/master/src/jupyter_contrib_nbextensions/nbextensions/python-markdown).
|
|
|
|
## Miscellaneous
|
|
|
|
- To export packages from Poetry to `requirements.txt` run `poetry export --without-hashes > requirements.txt`
|