Joaquim Moré López, senior researcher at the Barcelona Supercomputing Center, expert in Computational Linguistics and member of the Saint George on a Bike project, participated in one of the AI4EU Web Cafés which took place on 21 September 2021.
The AI4EU Web Cafés provide users with possibilities to participate virtually in live sessions with experts on specific AI domain or areas of interests. Saint George on a Bike’s session had a total of 53 attendees.
The talk was centered on the challenges that the Saint George on a Bike project has faced when describing paintings that depict scenes of the past and entities that belong to the supernatural. First of all, the challenges related to the differences between photographs and paintings were exposed, as well as topics such as to what extent the differences in the identification of objects are based on technical matters (e.g: differences in textures) or rather on the presence of different objects and actions altogether, or even the different disposition of objects in present day images compared to past images.
On the other hand, Moré also discussed aspects related to transfer learning, mainly when identifying supernatural beings and entities that are not likely to be found in present day photographs, and he reported on how Saint George on a Bike prevents the identification of entities that are anachronistic. Lastly, the talk dealt with the challenges in collecting training data for describing cultural heritage paintings. Moré presented the availability of images of paintings with their descriptions and will showed how these descriptions, especially when taken from art collections, must be first processed to select only the scene content, while leaving out content that introduces noise in the training (biographical data of the painter, for example).
More information about the AI4EU Web Cafés
