Category: News

An Interview with JGI Intern, Debby Olowu

Hi, my name is Debby. Currently, I am a 3rd-year Psychology with Innovation student at the University of Bristol. Earlier this year, for one of my Innovation modules, I was required to complete and write about an internship I took part in. I was privileged that the Jean Golding Institute (JGI) were able to support me in completing an internship for which I am incredibly grateful. Here, I will explain what I learnt from this internship and how it added to my learning.

What did you enjoy about the internship?

I enjoyed learning how the university operates behind the scenes. I particularly enjoyed their biweekly meetings where everyone goes around and introduces themselves and what they have been up to over the past week. This made me feel extremely comfortable because I could get insight into what everyone had been up to, and this made me feel incredibly involved. I also felt less pressure when giving my presentation because I had already met everyone the meeting before. I also enjoyed learning and tackling new projects which were investigating the National AI Strategy and Data Science for primary school students.

What did you learn and what skills do you think you developed?

I learned much from my internship here at the JGI. The biggest thing I learned from this internship was the national AI strategy. This is the government’s 10-year plan to become an AI powerhouse and improve AI across the country. The government has three main aims: the first is to provide the best of the best to work with AI. The second is to implement AI in different sectors such as the NHS. Finally, the last aim is to show people that AI is trustworthy. I did not know much about AI before researching this strategy, but now, I have learned so much about AI. Another thing I learned was about how the primary school and secondary school curriculum integrates data science and artificial intelligence. It was interesting to see the impact data science has on both curricula, but its impact is rarely acknowledged explicitly to students. Data science takes place in so many subjects: ones that most people would be aware of are sciences and maths. However, I was surprised to know that data science can also be incorporated into subjects such as geography and history. Yet, I believe the government should work harder to incorporate data science in the curriculum and to assess it better and originally this was done in coursework but due to significant levels of plagiarism, they had to stop. However, from my research, I feel that data science should be a separate subject to be studied so that students can understand its impact better and be prepared for when it is incorporated into their studies at university.

How has the experience added to your learning with respect to your degree programme?

As mentioned before, for one of my modules in my degree, I had to complete an independent internship module. The JGI not only allowed me to do this but to also improve the skills I use in assessments. This experience enabled me to improve my research and presentation skills. These are essential to my degree as to do well I must be able to research well, and this should strive to be in a way that is engaging yet informative.

Would you recommend an internship with the JGI and why?

I would recommend an internship with JGI especially if you are interested in a career in data science. Even though I am interested in a career in Psychology, conducting projects that require intense research and evaluating whether approaches were beneficial is a necessary aspect of any career, especially Psychology. This shows how doing an internship with the JGI will benefit and aid you, even if you are still deciding on a career path.

I am grateful for the opportunity to work at the JGI and especially to Emma Kuwertz for supporting me throughout my placement!

Turing Interest Groups – New groups launched

The Alan Turing Institute is pleased to announce that nine new Interest Groups have been launched in October 2022.

Interest Groups aim to promote research collaboration, share knowledge, and communicate emerging scientific concepts to the wider Institute and beyond, around a shared area of interest in data science and AI. In July 2022, a call for new Interest Groups was launched and the response was very positive, receiving a high number of applications from across the University partners, including the Turing University Development Award universities.

The selected Interest Groups cover a wide range of areas of research from theoretical and methodological areas to applications on biodiversity, health and space.

Please visit the Interest Groups webpages to learn more and to find out more information about joining.

The Interest Groups launched in 2022 are:

• Digital footprints linkages
• Neuro-symbolic AI
• Data-centric biological design and engineering
• Space science
• Health equity
• Meta-learning for multimodal data
• Biodiversity monitoring and forecasting
• Interpretation, modelling, and verification of information
• Simulation-based science

The Jean Golding Institute’s Secret Life of Data Competition and Awards Ceremony

When we think about the security of data on our phones and computers, we might think about passwords and permissions, or about data encryption – but we rarely think about what our data looks like, or what it does as it moves around hidden inside our phones, computers, digital devices, our apps and networks. This secret life of data – the traces, bits, and fragments of personal information that we leave behind us online – was the focus of this short story competition. The Jean Golding Institute, in collaboration with the Digital Security by Design (DSbD) Futures programme, delivered by the ESRC funded Discribe Hub+, hosted a short story competition exploring ‘the secret life of data’.

The competition sought creative stories that brought to life the secret life of data. The stories could imagine this life as a journey, a quest, a romance, or a tragedy; thinking of a computer’s internal architecture as a house, a jungle, a zoo, or a city; and the data as characters facing danger in the form of various digital threats and vulnerabilities.

The Jean Golding Institute were proud to host an awards ceremony on 2nd November, with readings of the extracts of all ten shortlisted stories, and the JGI extend their congratulations to the winners and runners up:

• 1st place: Guy Russell – The Task in the Eight-Bit Pyramid
• 2nd place: Fiona Ritchie Walker – Mini-Me
• 3rd place: Ben Marshall – The Courier

All ten shortlisted stories have been published in a Secret Life of Data Anthology, available to buy from Bristol Books.

JGI Seed Corn Funding Project Blog 2021: Michael Rumbelow and Alf Coles

Introduction

This seed corn project aimed to explore and extend uses of AI-generated data in an educational context. We have worked on an AI-based app to recognise, gather data on and respond to children’s arrangements of wooden blocks in mathematical block play. The project was inter-disciplinary in two ways. Firstly, the people involved crossed disciplines (teachers, academics, programmers) and, secondly, the app itself provokes engagement in creative activities involving music, chemistry and mathematics.

Developing an app to recognise real-world block play

Block play is a popular activity among children. And in schools there has also been a resurgence in the use of physical blocks in primary mathematics classrooms, particularly in the teaching of maths (drawing on some East Asian practices of using physical blocks as concrete models of abstract mathematical concepts). We were interested in researching children’s interactions with physical blocks, with the aim of supporting their learning across the curriculum, and one of the key challenges was how to capture data on children’s interactions with blocks for analysis.

Previous studies of block play have focused on gathering data variously through sketching or taking photos or videos of children’s block constructions, or embedding radio transmitters in blocks which could transmit their positions and orientations. Recently developments in computer vision technology offer novel ways of capturing data on block play. For example, photogrammetry apps such as 3D Scanner can now create 3D digital models from images or video of objects taken on mobile phones, and AI-based object recognition apps are increasingly able to detect objects they have been trained to ‘see’.

With funding from the JGI we were able to form a small project team of two researchers in the School of Education, a software developer and the head of a local primary school, in order to develop an app to trial with children in the school (see Figure 1).

Figure 1. The experimental set-up as used in the initial trial in a primary school

Technical Developments

Over the course of the JGI project we have developed the app in the following ways:

• We have rebuilt the app architecture robustly around the Detectron-2 AI algorithm, to facilitate reliable data gathering, training and feature development.
• We have developed a new mode to enable gathering of data on mathematical block play around proportion (ie detection of relative block sizes as well as adjacency) and carbon chemistry modelling (ie detection of multiple row block adjacency).
• We have made improvements to the user interface (eg removal of text from the screen for when testing with pre-literate users).
• We have tested the app with 5-6 year olds in a primary school.
• The new version generates snap shots of children’s block arrangements and exports data on their positions to a spreadsheet which allows further analysis.

Lessons Learned

As well as developing a prototype, we have been able to trial this phase of development in school, giving us several valuable insights into both the technical development of AI computer vision apps for gathering anonymous data on block play in schools, as well as the usability and potential of apps controlled by children via the arrangement of physical blocks on a tabletop. In particular we have found:

• Benefits of using platforms available to the target audience as and when feasible. Our aim was to develop an app which is ultimately usable by schools. At the time of development, the AI algorithms used required processing power beyond standard laptops to run at reasonable speeds, and dedicated AI processing hardware such as the Nvidia Jetson NX offered sufficient processing power at a fraction of the cost of higher-end GPU equipped laptops. However, during development, due largely to global chip shortages, this price difference disappeared, Jetson NX’s became scarce, and we decided to switch to higher-end GPU-equipped Windows laptops. This has simplified installation and portability of the app without the need for specialist hardware and opened a route to incremental optimization for the types of standard lower-spec laptops used in schools, as well as easing technical maintenance, and sharing and processing of the data gathered in standard apps such as spreadsheets.
• The resilience of trained artificial neural network algorithms in practice, as well as the importance of responsively optimising training image datasets. The app was trained to recognise blocks using training datasets originally gathered with a specific higher-spec webcam at a fixed distance from the table, which required a separate support apparatus. In practice when we tried using low-cost webcams with their own built-in gooseneck support these worked relatively well, at a variety of heights, and in a variety of lighting and tabletop environments in the field, and were much more practical to set up. However, dips in reliability became apparent in certain lighting conditions, for instance in distinguishing red and pink blocks, which highlighted the need for fresh training datasets using the new webcam, focusing on these areas of ambiguity apparent in field-testing.
• Children’s patience, curiosity and creativity in using novel technology. We had minimised the textual buttons in the interface designed for the researcher, to change modes etc, in the assumption that young children would not want to have to bother with them and that their presence might be confusing. In practice children, having seen the buttons used during set-up, were curious to bring up and explore all of the interface buttons themselves. They were also patient when the app occasionally did not immediately detect a block, ‘helping’ it to ‘see’ the block by nudging its position or re-laying it. And rather than copying what they had seen researchers or other children doing, the children were creative in exploring the affordances of the app, for example trying laying blocks horizontally rather than vertically, or reversing the order of a melody played by placing blocks.

Above all, this phase of development and trialling has provided evidence of the feasibility of producing an app which can use AI to detect and respond to block placements by young children in the field, and highlighted several of the key challenges for next steps.

Future Challenges

The potential uses of the app are extensive and, following on from the successes of this JGI project, we now want to:

• Develop our app, which is currently a prototype, into something potentially ready to move into production.
• Engage with Research Software Engineering (RSE) at the University of Bristol, to support further app development.
• Trial and hone the tools and games to support learning using the app
• Extend the dataset of images used to train the app from several hundreds to several thousands, aligned with the diverse webcams and conditions likely in the field
• Pilot the app with visually impaired and blind children
• Pilot the app with teachers interested in teaching climate chemistry
• Develop an anonymised dataset of children’s block play, including creative free play and guided mathematical block play (inspired by the UoB’s EPIC-KITCHENS data set https://epic-kitchens.github.io/2020-100)
• Enable upload, storage and visualisation of data on block arrangements on a server, for potential research analysis using AI to detect patterns
• Extend the app to recognise stacked as well as laid-flat block constructions, making use of LIDAR technology.

We are currently taking part in a training programme (SHAPE “Pre-accelerator” course) to help us plan the next stages of development.

Bayesian methods in Neuroscience – Conor Houghton

For the last century science has relied on a statistical framework based on hypothesis testing and frequentist inference. Despite its convenience in simple contexts this approach has proved to be intricate, obtuse and sometimes misleading when applied to more difficult problems, particularly problems with the sort of large, complex and untidy datasets that are vital for applications like climate modelling, finance, bioinformatics, epidemiology and neuroscience.

Bayesian inference solves this; the Bayesian approach is easy to interpret and returns science to its traditional reliance on evidence and description rather than a false notion of significance and truth. With a rigorous handling of uncertainty Bayesian inference can dramatically improve statistical efficiency, allowing us to squeeze more insight out of finite, hard-won data which in turn reduces animal and biological tissue use and reduces costs for scientific projects.

With support from the Jean Golding Institute we ran a workshop about Bayesian Modelling: our workshop had lots of different elements, a tutorial for people unfamiliar with the approach, short talks by people in the University who use these methods, a few talks by external speakers and a data study group. In retrospect, we did try to do too much, but the workshop was very helpful, the short talks brought together the local community around Bayesian Modelling and the two external speakers, Hong Ge and Mike Peardon, were excellent and provided real unexpected insight into the current and potential future state of Bayesian Modelling.

We hope to next host a workshop on Hybrid / Hamiltonian Monte Carlo; HMC has quickly become a very useful tool in data science, allowing us to perform Bayesian inference for a host of real world problems that would not have been tractable a few years ago. Perhaps surprisingly, HMC has its origins in high energy particle physics and was invented to perform the high-dimensional integrals involved in Quantum Chromodynamics, the calculations required to predict the results of collider experiments in CERN.

We believe that there is a still a lot these two communities  – particle physics and applied data science – can learn from each other when exploring and developing the power and scope of HMC.