WG 1: Spectral object documentation
Leader: Dr. Marcello Picollo (IT), vice-leader: Sérgio Nascimento (PT)
1st WG task st1.1 Identification, characterization and testing of spectral imaging techniques in the visible and near IR field
Spectral imaging techniques undergo a comparable change in technology as do spatial imaging techniques.
New developments in optical techniques lead to new means of splitting light resulting in new characteristics for instruments dedicated to monitor the optical spectrum for imaged surfaces. It is therefore necessary to explore the limits and advantages of the actual instruments in this waveband.
2nd WG task st1.2 Identification, characterisation and testing of imaging techniques beyond the visible and short wave radiation
The physical and chemical composition of surfaces is an important factor determining the interaction with light and reflection behaviour. As not all of these factors have an impact in the visible spectrum, instruments exist which are able to measure beyond this radiation. It is necessary to exploit and qualify also these type of instruments because they are often essential for the analysis of the surface composition.
The activities of COSCH WG1 are mainly focussed on the identification, characterisation and testing of two dimensions (2-D) spectral imaging techniques in the visible and near infrared (IR) field (task st1.1) and on the identification, characterisation and testing of imaging techniques beyond the visible and short wave radiation (task st1.2) for the study and documentation of CH artefacts. These tasks brought together research groups with different backgrounds and diverse research applications and aims. However, most of the efforts have been dedicated to the application of spectral imaging techniques to the investigation of artworks, mainly 2-D objects such as paintings.
- WG1 task force meeting in Florence (IT), March 2016
Task Force Meeting – Florence (IT) 10.03.2016 - Istituto di Fisica Applicata "Nello Carrara", CNR
Attending: Andrea Casini (IT), Costanza Cucci (IT), Sony George (NO), João Linhares (PT), Lindsay MacDonald (UK), Cristina Montagner (PT), Sérgio Nascimento (PT), Marcello Picollo (IT), Ruven Pillay (FR), Armonie Sauzet (FR), Lorenzo Stefani (IT), Tatiana Vitorino (PT), E. Keats Webb (UK)
Participants of the Task force meeting at IFAC-CNR.
Presentation by Marcello Picollo to introduce the objectives of the meeting:
- To discuss about the outcomes of the RRT
- To discuss possible participation in COSCH book
- To complete a reference list on different techniques/spectral regions
- To complete a glossary a terms
Participants listening to Picollo's presentation.
Presentation by E. Keats Webb to present the Round Robin Test experience:
- Introduction of the test objects
- Short description of the STSMs developed
- Current state of the data, including a summary of multi- and hyper-spectral systems, institutions, and users involved, and the challenges and issues associated with the data
- Future work, including receiving the data that is still missing, further research and processing of data, and creation of guidelines and best practices
Webb presenting the RRT experience.
Open discussion to decide how to obtain results from the RRT to write the final report:
- Selection of groups/people to work on the multispectral RRT data
- Definition of tasks and questions that the participating institutions should carry out and answer
- Dissemination through conferences and COSCH book
- Distribution of tasks to complete the references list and glossary
Visit to IFAC-CNR's imaging spectroscopy laboratory at the end of the meeting.
- Autumn WG meeting - Neuchâtel (CH), October 2015
- CAA 2015, COSCH Special Session in Sienna (IT), April 2015
- Spring MC&WG Meeting - Saint Etienne (FR), March 2015
- CCIW'15, COSCH Special Session in Saint Etienne (FR), March 2015
WG1 has been actively involved in discussing the following themes:
1. Standardising the acquired imaging data and the calibration procedures to be followed with the diverse imaging systems.
2. Creating a well-defined and structured Round Robin Test (RRT) in order to compare colour and spectroscopic measurements, as well as information on calibration standards and laboratory mock-ups obtained through the use of diverse imaging devices developed by the different research groups that participate in the COSCH Action.
3. Exploring the possibilities offered by different technical and methodological approaches for the acquisition of multi- and hyper-spectral imaging data.
4. Implementing knowledge, guidelines, good practices and standardised methodologies with respect to the application of the numerous spectral imaging devices used to study and document cultural heritage.
Autumn WG Meeting – Neuchâtel (CH), 13.10.2015 - Haute Ecole Arc Conservation-restauration, Campus Arc 2
Attending: Irina Ciortan (RO), Sony George (NO), Jon Yngve Hardeberg (NO), J. Jussila (FI), João Linhares (PT), Lindsay MacDonald (UK), Sérgio Nascimento (PT), Marcello Picollo (IT), Ruven Pillay (FR), E. Keats Webb (UK)
STSM invited presentation dealing with WG1 activities
- E. Keats Webb: "COSCH STSM WG1: Elaboration of Hyperspectral Image Data from Round Robin Test Acquisition"
Participants of the WG1 meeting at the COSCH Neuchâtel autumn meeting.
WG1 meeting Summary
- Agreement letter: Hardcopy of letter getting passed around
- RRT experience (completed by, data shared by, calibrated data shared by)
- Processing RRT data
M. Picollo—panel painting
S. George and I. Ciortan—color chart
R. Pillay—Involvement with VNIR hyperspectral data
STSM on RRT objects
COSCH report on WG1 activities
- RRT data published on ISI scientific journal with IF. Use Andras Jung paper as model to structure our paper
- Reference lists on different techniques/spectral regions: list and pdf files
- Glossary: Still a little unclear about what is wanted/needed for the COSCH Glossary
CAA 2015, COSCH Special Session in Sienna (IT), 31.03.15
At the 43rd Computer Applications and Quantitative Methods in Archaeology conference (CAA 2015), Siena (Italy), March 30 - April 3 2015, COSCH supported a special session on colour in cultural heritage, chaired by Anna Bentkowska-Kafel, to which two oral and one poster presentations from the action's community were selected. The oral presentations dealt with the application of hyper-spectral imaging techniques to the investigation of concealed layers of paintings, mainly covering the WG1 activities, and of 3D technologies for the documentation of ancient Roman coins. The session testified the strong interest from scientists and researchers with different cultural backgrounds (museum professionals, archaeologists, art historians, digital humanities scholars) in the application of 2D and 3D spatial and spectral documentation of material cultural objects.
Spring MC&WG Meeting – Saint Etienne (FR), 26-28.03.2015 - Telecom Engineer School, University Jean Monnet
Attending: Corinna Ludovica Kock Dandolo (DK), Elodie Herens (BE), Irina Ciortan (RO), Jaroslav Valach (CZ), Julio M. del Hoyo Melendez (PL), Lindsay MacDonald (UK), Manfred Schreiner (AT), Marcello Picollo (IT), Raju Shresthat (NO), Ruven Pillay (FR), Sérgio Nascimento (PT), Sony George (NO), Tatiana Vitorino (PT), Vera Moitinho de Almeida (CY)
Invited presentation dealing with WG1 activities
- Corinna Ludovica Koch Dandolo: "Terahertz Time-Domain Imaging for Imaging Analysis of Panel Paintings"
WG1 meeting Summary
Round Robin Test (most of the time of the meeting was dedicated to this crucial point)
- The project manager (S. George) continues organising the RRT and makes sure that all the participating groups will follow the defined time-schedule.
- It was decided to nominate a person to be responsible for each specific topics/objects, in order to facilitate the organisation and management of the data.
- I. Ciortan and S. George were responsible for managing data related to the X-Rite ColorChecker chart.
- L. MacDonald became responsible for the icon's data.
- M. Picollo and T. Vitorino were in charge of the data concerning the painted panel.
- S. Nascimento suggested that there should be a written agreement between all the research groups involved in the RRT to avoid any eventual legal problems and to clarify to all participants what is being done within the Round Robin exercise and what are its purposes.
(left) Picollo's talk on "Presentation of WG1 Outputs"; and (right) Picollo and Nascimento (WG1 Leader and Vice-Leader) during the coffee break at the COSCH MC & WG, Spring 2015 St. Etienne Meeting.
CCIW'15, COSCH Special Session in Saint Etienne (FR), 26.03.2015
At the 5th Computational Color Imaging Workshop (CCIW 2015), Saint Etienne (France), March 24 - 26 2015, COSCH supported a special session on colour in cultural heritage. The session was mostly related with digitisation and visualisation of cultural heritage objects, and it was well attended by researchers with different backgrounds. COSCH was represented by two invited and two oral presentations on colour accuracy the conference was a successful opportunity for promoting the action's activities.
09h00 – 10h00. Invited Speaker: Zoltan Kao, University of Szeged (Hungary), "Relative pose estimation and fusion of 2D spectral and 3D lidar images"
10h00 – 10h30. Coffee Break
10h30 - 11h00. Jay Arre Toque, Pengchang Zhan, Peng Wang, Ari Ide-Ektessabi (Japan), "High-resolution multispectral scanning for mesoscopic investigation of discoloration of traditional Japanese pigments"
11h00 - 11h30. Citlalli Gámez Serna, Alain Trémeau, Ruven Pillay (France), "Data fusion of objects using techniques such as Laser Scanning, Structured Light and Photogrammetry for Cultural Heritage Applications"
11h30 - 12h00. Tatiana Vitorino, Andrea Casini, Costanza Cucci, Ana Gebeje, Jouni Hiltunen, Markku Hauta-Kasari, Marcello Picollo, Lorenzo Stefani (Italy & Finland), "Accuracy in colour reproduction: using a ColorChecker chart to assess the usefulness and comparability of data acquired with two hyper-spectral systems"
14h00 - 15h00. Invited Speaker: Lindsay McDonald, University College London (UK), "Representation of cultural heritage objects by image sets with directional illumination"
15h00 - 15h30. Sérgio M.C. Nascimento, João M.M. Linhares, Catarina A. R. João, Kinjiro Amano, Cristina Montagner, Maria J. Melo, Marcia Vilarigues (Portugal), "Estimating the colors of paintings"
- WG1 Training School in Florence (I), December 2014
- Belgrade meeting (RS), September 2014
- WG1 - ICISP Special Session in Cherbourg (F), June-July 2014
- Task force meeting in Cherbourg (F), June 2014
- Joensuu meeting (FIN), March-April 2014
- Task force meeting in Braga (P), January 2014
WG1 Training School in Florence (IT), 10-12.12.2014
The 2014 COST-COSCH Training School on "Hyperspectral imaging – Techniques applied to the investigation of 2D polychrome surfaces" was organised in Florence by the IFAC-CNR Applied Spectroscopy research group. The idea of the Training School was to provide a general overview of hyper-spectral technologies for artworks investigations, mainly paintings. The program was multidisciplinary and took into consideration different approaches to the topic in order to meet the needs of the diverse professionals working in and competences applied to this field.
The class included 16 participants, who had different backgrounds and came from various European countries, which resulted in a wide representation of fields and nationalities, thus making it a multi-disciplinary group inclined to discuss and exchange ideas on the application of hyper-spectral imaging techniques to the investigation of paintings and other art objects.
The IFAC-CNR organizing Committee: Marcello Picollo, Costanza Cucci, Andrea Casini, Lorenzo Stefani, Filippo Micheletti, Eva Mariasole Angelin, Carlotta Stevani
Participants of the Training School at the Museum of San Marco, Florence.
Participants of the Training School listening to Costanza Cucci's presentation on 2-D hyper-spectral imaging devices and data acquisition.
Visit of the restoration laboratories of the SSPSAE e per il polo museale della città di Firenze, Florence, guided by Marina Ginanni and Elena Prandi.
Fall MC Meeting – Belgrade (RS) 15-17.09.2014 - Mathematical Institute of the Serbian Academy of Sciences and Arts and Faculty of Mathematics
Attendees: I. Ciortan (RO), A. Gebejes (FI), S. George (NO), J. Hoyo Melendez (PL), M. Picollo (IT), T. Vitorino (PO)
Presentation: M. Picollo: "Limits and advantages of different 2D VIS-NIR spectral imaging systems in answering conservators' questions".
The first RRT results were reported and more laboratories decided to join the RRT experience.
As defined in Belgrade the laboratories participating to the RRT were
1) University of Eastern Finland, Joensuu, Finland
2) UCL London, UK
3) Gjovik University Norway
4) IFAC-CNR, Florence, Italy
5) Imaging & Media Lab, Universität Basel, Switzerland
6) University of Leipzig, Germany
7) University of Minho, Braga, Portugal
8) CD6-UPC Terrassa, Barcelona, Spain
9) Museum in Krakow, Poland
10) Centre de Recherche et de Restauration des Musées de France Musée du Louvre, Paris, France
11) Norsk Elektro Optikk AS, Norway
12) Institute of Theoretical and Applied Mechanics of the Academy of Sciences, Prague, Czech Republic
13) University of Burgundy, France
14) University of Milan-Bicocca, Italy
2nd WG1 Task-Force Meeting - Cherbourg (FR) 30.06.2014 - IUT Cherbourg Manche
Attendees: F. Deger (NO), F. J. Burgos (ES), P. Fält (FI), M. Flinkman (FI), A. Gebejes (FI), S. George (NO), M. Hauta-Kasari (WG1 chair, FI), A. Karmacharya (DE), L. MacDonald (UK), A. Mansuri (local-organizer, FR), C. Montagner (PO), M. Picollo (WG1 vice-chair, IT), J. Sakamoto (FI), M. Vilaseca (ES), T. Vitorino (PO), S. Wefers (DE).
Participants of the task-force at the end of the meeting. A. Mansouri is not present in the picture due to his ICISP conference organisation responsibilities; S. George was looking for Mansouri; while P. Fält, M. Flinkman, A. Gebejes, and J. Sakamoto were attending on-going sessions.
Discussion about the Round Robin Test objects and their ongoing measurements:
- Round Robin Test 1: X-Rite® ColorChecker Classic (provided by M. Hauta-Kasari);
ColorChecker chart (280 mm x 216 mm) to define the characteristic of each imaging device in colour rendering.
- Round Robin Test 2: X-Rite® White Balance (provided by M. Hauta-Kasari);
White Balance chart (280 mm x 216 mm) to define the level of homogeneity in illumination during the image acquisition and in detector elements.
- Round Robin Test 3: SphereOptics Zenith Polymer Wavelength Standard Calibration Standard (provided by A. Jung);
New reference panel of PTFE mixed with rare earth elements (erbium, dysprosium and holmium) to define the spectral accuracy and resolution of each imaging device.
- Round Robin Test 4: Antique Russian icon (1899) printed on copper plate glued to a wooden support (provided by L. MacDonald);
Russian icon (265 mm x 220 mm) representing the "Virgin of Kazan" and marked Moscow 1899, to stress the behaviour of the different imaging device when highly reflective surfaces, such as gold background, are investigated.
- Round Robin Test 5: test panel painted with medieval Tuscan technique (provided by M. Picollo).
Tempera painting mock-up with gypsum/canvas/gypsum ground on wood, made by conservators at the Restoration Laboratories of the Soprintendenza Speciale per il Patrimonio Storico, Artistico ed Etnoantropologico e per il Polo Museale della città di Firenze, to highlight the performances of the different imaging devices in penetrating the paint layers and detecting the under-drawings.
Results of the WG1 Taskforce Meeting in Cherbourg
- Presentations of the selected five objects and the purpose of their investigation with special focusses on the application in the art/archaeological conservation fields.
- Definition of possible connections with WG2 to link 3D with multi- and hyper-spectral imaging data.
- Presentation of the RRT results to conservation (art and archaeology) field experts and colour conference, such as AIC and CAA.
- Having end-users to test the results produced by the RRT and co-authoring join papers to be published on conservation and conservation-science journals.
Spring MC Meeting – Joensuu (FI) 31.03-01.04.2014 – University of Eastern Finland
Attendees: J. del Hoyo Melendez (PL); H. Skjerping, R. Shrestha, S. George (NO); T. Saarinen, T. Saarinen, M. Hauta-Kasari, H. S., J. Sakamoto (FI); D. Rieke-Zapp (DE); L. MacDonald (UK); A. Mansouri (FR); J. Linhares, S. Nascimento, T. Vitorino (PO); M. Picollo (IT); B. Marinkovic (RS); D. Strivay (BE)
STSM 2013 invited presentation dealing with WG1 activities
- Tatiana Vitorino: "Hyper-spectral Acquisition on Historically Accurate Reconstructions of Red Organic Lakes"
WG1 meeting Summary
Round robin test (most of the time of the meeting was dedicated to this crucial point)
- The project manager (S. George, Norway) will continue organising the RRT and make sure that all the participating groups will follow the defined time-schedule.
- Update on the data acquisition parameters and expected results (fine tuning and more details).
- Testing of samples is underway. There is a need for people that will be responsible for analysing and evaluating the dataset.
- The dataset will be available as supplementary material on a paper or a central website that supports raw data in various formats.
- Handling and transporting protocol for the icon as well as data delivery proposals.
STSM call for proposals: specific announcement for a candidate or candidates with experience in analysis and evaluation of HSI data (support person for RR testing).
1st WG1 Task-Force Meeting - Braga (PO) 27-28.01.2014 - Minho University; Dept. of Physics
Attendees: F. Boochs (DE); F.J. Burgos (ES); S. George (NO); J. Linhares (PO); L. MacDonald (UK); S. Nascimento (PO); M. Picollo (IT); H. Skjerping (NO).
Participants of the task-force meeting during the guided tour of the Colour Science Laboratory offered by Sérgio Nascimento.
Presentations of the activities of the groups participating at the meeting:
- Sérgio Nascimento, Colour Science Laboratory, Uminho: "Applications of spectral imaging in art and cultural heritage"
- Marcello Picollo, Applied Spectroscopy Lab., IFAC-CNR: "Fiber Optic Reflectance Spectroscopy (FORS) and Hyper-spectral Imaging (HSI) Techniques applied to the analysis of polychrome surfaces"
- Antonio Cardoso, Signinum Restoration Company: "Syddarta Project"
- Francisco J. Burgos, Centre for Sensors, Instruments and Systems Development (CD6), UPC: "Spatial and spectral object reconstruction at the CD6"
- Lindsay MacDonald, Photogrammetry, 3D Imaging and Metrology Research Centre, UCL: "Using Filters in Multispectral Imaging"
- Sony George, The Norwegian Colour and Visual Computing Laboratory, Gjovik University: "CH Imaging @ The Norwegian Colour and Visual Computing Laboratory"
- Hallvard Skjerping, NEO: HySpex
- Francisco J. Burgos, University of Eastern Finland (on behalf of Markku Hauta-Kasari): "Spectral analysis of Finnish icons with spectral imaging techniques"
Sérgio Nascimento presenting the Colour Science Laboratory research activities.
Presentation of the Round Robin Test and the definition of its targets
- Francisco J. Burgos, University of Eastern Finland (on behalf of Markku Hauta-Kasari, UEF): "X-Rite Color Checker® CLASSIC, first results from UEF and next steps"
- Marcello Picollo, Applied Spectroscopy Lab., IFAC-CNR: "Painted test panel. Definition of the main scope of the preparation of the panel (or more than one); its structure / construction / stratigraphy / materials used and explanation of why they were selected"
Presentation of the COSCH Knowledge Representation
- Frank Boochs, Mainz University of Applied Sciences: "Knowledge Representation (KR)"
Frank Boochs' presentation on "COSCH Knowledge Representation".
Results of the WG1 Taskforce Meeting in Braga
- Presentations of the activities of the diverse groups by each participant.
- Definition of STSM keywords: Calibration of imaging spectroscopic devices; Acquisition, elaboration, exporting, and storing imaging data-cubes; Multi-spectral and hyper-spectral imaging; Analysis and rendering of spectral image datasets; Accuracy and reproducibility of spectral imaging systems; Visualisation case studies (individual and joint)
- Final output of WG1: Handbook on the best measurement procedures to be followed by users (people working in CH conservation field)
- Knowledge Schema: Nomination of WG1 coordinator;
- Collection of respective facts: First step focussed on definition of methodological / technical data on the imaging devices within WG1 teams (defined by F. Boochs as "realisation of an appropriate KR using state-of-the-art technologies");
- Selection of typical scenario within WG1 (WG1 directly connected to WG4 activities);
- Delivery of facts to COSCHKR operative team.
2014 - ICISP Special Session
At the International Conference on Image & Signal Processing (ICISP 2014), Cherbourg, Normandy (France), June 30 – July 2 2014, COSCH supported a special session on Digital Cultural Heritage, chaired by Alamin Mansouri and Frank Boochs, to which four oral and two poster presentations were selected. The oral presentations dealt with the application of multi- and hyper-spectral imaging techniques to the investigation of artworks and artists' materials mainly covering the COSCH WG1 activities. The session was well attended and several questions from the audience were addressed to the speakers. This testified the strong interest from scientists and researches with different cultural backgrounds in the application of multi- and hyper-spectral imaging systems, and their data elaboration, to the cultural heritage field. Furthermore, COSCH was well represented and the conference was a successful stage for promoting COSCH activities.
Sony George, Ana Maria Grecicosei, Erik Waaler, Jon Yngve Hardeberg:
Lindsay MacDonald, Maria Filomena Guerra, Ruven Pillay, Mona Hess, Stephen Quirke, Stuart Robson, Ali Hosseininaveh Ahmadabadian:
Tatiana Vitorino, Andrea Casini, Costanza Cucci, Maria João Melo, Marcello Picollo, Lorenzo Stefani:
Hilda Deborah, Sony George, Jon Yngve Hardeberg:
Mihajlovic, V. Jelisavcic, B. Marinkovic, M. Todorovic, Z. Ognjanovic, S. Tomovic, V. Stojanovic, V. Milutinovic: "Serbia Forum Digital Cultural Heritage Portal".