Under the hood for Noosa Shire Council

More of the gory details of how information gets into PlanningAlerts. This is here so you can see and learn how it's done but also so you are able to fix things and see in detail what isn't working.

The steps to getting data into Planning Alerts

  1. Applications are published on the Noosa Shire Council website in a human readable, non-structured form.
  2. The latest scraper code on Github is loaded by our scraping platform morph.io.
  3. The scraper planningalerts-scrapers/multiple_technology_one on our scraping platform morph.io collects the information daily and converts it into a machine-readable format.
  4. If the scraper errors anyone who is watching the scraper on morph.io gets informed via a daily email alert.
  5. The machine readable data is validated, imported and geocoded by PlanningAlerts daily. If there are any validation errors on an application, the application is skipped and the error is logged. See below for the most recent logs.
  6. The information is published on PlanningAlerts, made available via the API, and people are informed of new applications via email alerts.

Most recent import logs

Error Validation failed: Description can't be blank while trying to save application EXE25/0019 for Noosa Shire Council, QLD. So, skipping
Error Validation failed: Description can't be blank while trying to save application EXE25/0020 for Noosa Shire Council, QLD. So, skipping
Error Validation failed: Description can't be blank while trying to save application HHA25/0012 for Noosa Shire Council, QLD. So, skipping
Error Validation failed: Description can't be blank while trying to save application HHA25/0013 for Noosa Shire Council, QLD. So, skipping
Error Validation failed: Description can't be blank while trying to save application SSL25/0108 for Noosa Shire Council, QLD. So, skipping
Error Validation failed: Description can't be blank while trying to save application SSL25/0109 for Noosa Shire Council, QLD. So, skipping
Error Validation failed: Description can't be blank while trying to save application SSL25/0110 for Noosa Shire Council, QLD. So, skipping
Error Validation failed: Description can't be blank while trying to save application SSL25/0111 for Noosa Shire Council, QLD. So, skipping
Error Validation failed: Description can't be blank while trying to save application SSL25/0112 for Noosa Shire Council, QLD. So, skipping
Error Validation failed: Description can't be blank while trying to save application SSL25/0113 for Noosa Shire Council, QLD. So, skipping
Error Validation failed: Description can't be blank while trying to save application SSL25/0114 for Noosa Shire Council, QLD. So, skipping
Error Validation failed: Description can't be blank while trying to save application SSL25/0115 for Noosa Shire Council, QLD. So, skipping
Error Validation failed: Description can't be blank while trying to save application SSL25/0116 for Noosa Shire Council, QLD. So, skipping
Error Validation failed: Description can't be blank while trying to save application SSL25/0117 for Noosa Shire Council, QLD. So, skipping
Error Validation failed: Description can't be blank while trying to save application SSL25/0118 for Noosa Shire Council, QLD. So, skipping
Error Validation failed: Description can't be blank while trying to save application SSL25/0119 for Noosa Shire Council, QLD. So, skipping
Error Validation failed: Description can't be blank while trying to save application SSL25/0120 for Noosa Shire Council, QLD. So, skipping
Error Validation failed: Description can't be blank while trying to save application SSL25/0121 for Noosa Shire Council, QLD. So, skipping
Error Validation failed: Description can't be blank while trying to save application SSL25/0122 for Noosa Shire Council, QLD. So, skipping
Error Validation failed: Description can't be blank while trying to save application SSL25/0123 for Noosa Shire Council, QLD. So, skipping
Error Validation failed: Description can't be blank while trying to save application SSL25/0124 for Noosa Shire Council, QLD. So, skipping
Error Validation failed: Description can't be blank while trying to save application SSL25/0125 for Noosa Shire Council, QLD. So, skipping
Error Validation failed: Description can't be blank while trying to save application SSL25/0126 for Noosa Shire Council, QLD. So, skipping
Error Validation failed: Description can't be blank while trying to save application SSL25/0128 for Noosa Shire Council, QLD. So, skipping
Error Validation failed: Description can't be blank while trying to save application SSL25/0129 for Noosa Shire Council, QLD. So, skipping
Error Validation failed: Description can't be blank while trying to save application SSL25/0130 for Noosa Shire Council, QLD. So, skipping
Error Validation failed: Description can't be blank while trying to save application SSL25/0131 for Noosa Shire Council, QLD. So, skipping
Error Validation failed: Description can't be blank while trying to save application SSL25/0132 for Noosa Shire Council, QLD. So, skipping
Error Validation failed: Description can't be blank while trying to save application SSL25/0133 for Noosa Shire Council, QLD. So, skipping
Error Validation failed: Description can't be blank while trying to save application SSL25/0134 for Noosa Shire Council, QLD. So, skipping
Error Validation failed: Description can't be blank while trying to save application eBin25/0155 for Noosa Shire Council, QLD. So, skipping
Error Validation failed: Description can't be blank while trying to save application eBin25/0156 for Noosa Shire Council, QLD. So, skipping
38 applications found for Noosa Shire Council, QLD with date from 2025-05-12
32 applications errored for Noosa Shire Council, QLD with date from 2025-05-12
Took 6 s to import applications from Noosa Shire Council, QLD

What you can do next

If something isn't right with the scraper or the data coming in then you could do one or several of the following:

If everything is working fine right now but you want to help if something goes wrong:

  • Watch the scraper on morph.io, so you will get an email if it errors. Press the "Watch" button in the top right while you're logged in to morph.io.
  • View any scraper issues. Help fix them or comment on them if they are out of date