This blog post describes how we transformed and ingested weather data using Apache Nifi.
This blog discusses how D2D CRC has seeked to understand the true meaning of a data scientist.
This blog post delves into the world of narrative visualisation and how it can be applied to investigations.
This blog explores the probability of duplicate names in an office of software engineers.
Architecture principles can provide a basis for decision making when developing solutions. This blog post describes Big Data-specific architecture principles used by D2D CRC.
This blog post provides a snapshot of the thought process we use when approaching a Big Data problem.
In this post we discuss some of the challenges we faced with related term suggestions and our approach to rapidly standing up a baseline solution before expending effort on more advanced solutions.
This blog post describes some of the challenges and the lessons learnt from using Agile on Big Data projects at D2D CRC.
In this post we will give a brief introduction to the concept of perceptual hashing of images, and demonstrate the simple technique we used.
Finding your first job out of University can be a daunting experience. It’s often difficult to know where to start or what skills and expertise employers are looking for.
The Beat the News team at Data to Decisions CRC (D2D CRC) have our heads buried (for the most part) in Spark for big data analytics. Naturally, we dabble a lot in the Scala programming language to support our Spark processing.