Data Needs Testing Too | BCS London Branches

Speaker:
Ron Ballard - Database Consultant and Author

Synopsis:
Application developers typically test their code, often with large suites of automated tests, before each new release.

But, when the application is running live, it will be receiving data from multiple sources, over which we may have little control, and that data will sometimes be unexpected and invalid in some way.

The impact of this can be dramatic, as with the faulty flight plan that brought Gatwick to a standstill on 28 August 2023. Several days of chaos were caused by one bad flight plan breaking a system that had been running reliably for years.

The impact was estimated at £100 million.

In this talk we look at:
•the various ways in which data can enter your application
•what can be done to defend against bad data in each case
•practical techniques for profiling and cleaning data sources
•monitoring the quality of data in your systems