We’ve started to collate a page of decent data sources.  It’s currently separated into international and Australian sources, and It’ll grow with time:

Links to data sources

If you’re looking for data in Australia, you can’t go past the 2015 list from the team at GovHack:

https://www.govhack.org/2015-data/