Under the hood of Berri Barmera Council
More of the gory details of how information gets into PlanningAlerts. This is here so you can see and learn how it's done but also so you are able to fix things and see in detail what isn't working.
- Applications are published on the Berri Barmera Council website in a human readable, non-structured form.
- The latest scraper code on Github is loaded by our scraping platform morph.io.
- The scraper planningalerts-scrapers/berri_barmera_council_sa_development_applications on our scraping platform morph.io collects the information daily and converts it into a machine-readable format.
- If the scraper errors anyone who is watching the scraper on morph.io gets informed via a daily email alert.
- The machine readable data is validated, imported and geocoded by PlanningAlerts daily. If there are any validation errors on an application, the application is skipped and the error is logged. See below for the most recent logs.
- The information is published on PlanningAlerts, made available via the API, and people are informed of new applications via email alerts.
Most recent import logs
Error Validation failed: Date received can not be in the future while trying to save application 752/007/19 for Berri Barmera Council, SA. So, skipping
146 applications found for Berri Barmera Council, SA with date from 2019-11-24 to 2019-12-08
1 application errored for Berri Barmera Council, SA with date from 2019-11-24 to 2019-12-08
Took 2 s to import applications from Berri Barmera Council, SA
What you can do next
If something isn't right with the scraper or the data coming in then you could do one or several of the following
- Report or view scraper issues
- Fork the scraper on Github and try to fix it
- If it's an issue with the council website, then contact Berri Barmera Council
- Contact us for help
If everything is working fine right now but you want to help if something goes wrong