Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage

46
Andrea Scianna, Susanna Gristina [email protected], [email protected] GEOGRAPHIC FREE AND OPEN SOURCE SYSTEMS FOR MULTIMEDIA FRUITION OF CULTURAL HERITAGE GISLab CNR-IBAM / UNIPA-DICAM Università degli Studi di Palermo – Viale delle Scienze – Edificio 8 Tel. Fax +39 91 23896225 – e-mail: [email protected] http://gislab.geomatica.unipa.it

Transcript of Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage

Andrea Scianna, Susanna Gristina [email protected], [email protected]

GEOGRAPHIC FREE AND OPEN SOURCE

SYSTEMS FOR MULTIMEDIA FRUITION OF CULTURAL HERITAGE

GISLab CNR-IBAM / UNIPA-DICAM Università degli Studi di Palermo – Viale delle Scienze – Edificio 8

Tel. Fax +39 91 23896225 – e-mail: [email protected] http://gislab.geomatica.unipa.it

Research activities conducted

Research topic

Development perspectives of the research

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

GISLab CNR/UNIPA research activities’ steps

USE OF GFOSS SYSTEMS FOR CONSERVATION AND FRUITION OF CULTURAL HERITAGE

Analysis of the needs in the field and first experiments

EXEMPLES OF APPLICATION.

TRANSITION FROM PROPRIETARY SOFTWARE TO FOSS

Tema di ricerca dottorale e sue basi di partenza

Dottorato di Ricerca in Ingegneria Civile ed Ambientale - Ingegneria delle Infrastrutture Viarie e Geomatica - XXVI ciclo Dottoranda: Arch. Susanna Gristina

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

Research topic

3D representation

3D geographical data storage

Updating and sharing information on the web

REQUIREMENTS FOR DATA STORAGE, MANAGEMENT AND FRUITION OF CULTURAL HERITAGE:

Visualization

• Interactive systems for virtual navigation

• Augmented reality • ..............................

Data consultation • Off line • On line • On mobile device

3D information systems for ch

Focus on Monumental and Archaeological Heritage

Solunto, Santa Flavia (PA) (IVth cent. B.C.)

Castle of Maredolce, Palermo (XIInd cent. A.D.)

Inquisition’s Prison, Palermo (XVIIth cent. A.D.)

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

Research topic

3D multi-scale cartographic

models

Urban environment Cultural Heritage field

GIANT 3D (Geographical Interoperable Advanced Numerical Topological

3 Dimensional cartographic model)

Experiments on 3D information systems (Inquisition’s Prison, Palermo; Castle of Maredolce, Palermo; Horti Lamiani

Ninfeum – Rome; Roman structures in the crypt of the church of SS. Sergio e Bacco, Rome; Porta dei Greci, Palermo; Florio tuna cannery, Favignana)

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

Research topic

Multipatch (by Esri) GeoVRML CityGML

Some exemples (URBAN ENVIRONMENT)

TOWARDS A 3D GIS: 2,5D GIS

3D INFORMATION SYSTEMS

Status questionis

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

Research topic

USE OF GFOSS IN URBAN ENVIRONMENT

GIANT 3D

(Geographical Interoperable Advanced Numerical Topological

3 Dimensional cartographic model)

- Blender and geodatabase interaction using Python scripts - 3D viewer to visualize geographic data of a predefined model (model’s structure and attributes) - Applet Viewer WFS3D: to visualize and query both the 3D reality-based model and its data on the web

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

Research topic

3D INFORMATION SYSTEMS FOR CH

Status questionis

Integration between 3D models and DB. Experiments on different systems.

Towards a 3D GIS

PDF 3D HBIM (Heritage Building Integration Model)

Semantic 3D models SCIANNA A. 2011; ANZALONE G. 2011

SCIANNA A. et al. 2013; DORE, MURPHY 2012

DE LUCA et al. 2011; APOLLONIO et al. 2012

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

Research topic

Timeline

Location

Identification data

From only visualization...

...to support to information

3D MODELS

Administrative data

Documents, references, images

Typological and morphological data

Construction tecniques

Condition of the building

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

Research topic

Accessibility to heterogeneous data

by different users

3D applications for CH. Specific

requirements

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

Research topic

Multi-scale data management and analysis

On line

Extension of 2D spatial information to 3D (space) and 4D (time)

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

Research topic

3D applications for CH. Specific

requirements

Geometric complexity management

Geographic component

Irregular morphologies. Lack of integrity of the building components.

Fragmentary nature of the finds.

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

Research topic

3D applications for CH. Specific

requirements

PROPRIETARy SOFTWARE

e.g. Rhynoceros, MICROSOFT Access (first experiments)

FOSS

Blender, Posgresql+postgis

to implement a multimedia tool aimed at: - DIGITAL ARCHIVING AND CATALOGUING CULTURAL HERITAGE - PRELIMINARY ANALYSIS FOR CONSERVATION - MULTIMEDIA FRUITION OF CH (INTEGRATED WITH INFORMATION SPATIAL SYSTEMS)

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

Research activities conducted

Conceptual models for cataloguing data

concerning Archaoelogical and Architectural Heritage

Structuring of RDBMS for CH

3D modeling tecniques

3D GIS

BLENDER (3D modeling)

3D PDF (GUI)

APPLICATION

TOPICS AND TOOLS CONCERNING THE APPLICATION

PostgreSQL (RDBMS)

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

Research activities conducted

Thesaurus

Implementation of Cultural Heritage 3D information systems

Steps:

1. Construction of a conceptual and a logic model

2. Construction of a 3D physical model

3. Project of an access mode to 3D information

4. Construction of the GUI

5. Project for sharing the model on the web

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

Research activities conducted

The case study. The Arab-Norman sollazzi in Palermo

Regional-scale representation and analisys. 2D GIS

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

Research activities conducted

The case study. The Castle of Maredolce

Architectural-scale representation and analisys. From 2D GIS to 3D PDF

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

Research activities conducted

Tools

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

Research activities conducted

Thesaurus

system design • cognitive framework of the artifact; • analysis of the building system,

decomposition in parts and elements, classification based on hierarchical and relational criteria;

• database project;

data acquisition;

implementation of a 2D GIS (aimed at a regional-scale analysis) concerning the system of monumental buildings belonging to the same period and cultural context;

implementation of the 3D model of one of the system’s buildings (aimed at an architectural-scale analysis);

implementation of the GUI based on PDF format;

exportation of the 3D model (from the modeling software to the 3D PDF format);

connection establishment between database and 3D model through ODBC;

on line publication of the 3D information system (WebGIS for the regional-scale, linked through a hyperlink to the 3D PDF for the architectural scale).

THE 3D PDF APPLICATION. THE WORKFLOW

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

Research activities conducted

TOWARDS A 3D DATABASE: STRUCTURING A DATABASE FOR ARCHITECTURE AND ARCHAEOLOGY

Evaluation of the type of data concerning

archaeological and architectural

artifacts and their heterogeneity

Sources of cataloguing data

concerning Archaeological

Heritage (by MiBACT-SSBAR SITAR Project Data

Model)

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

Research activities conducted

Type of data

ALPHANUMERICAL DATA

bibliography archival documents literary sources epigraphic sources ancient iconographic sources

RASTER

photos videos drawings

CATALOG CARDS

produced by research

VECTORIAL OR GEOREFERENCED

current maps historical maps topographic relief

Reports of archaeological excavations Geological reports Summaries related to archaeological and monumental evidences Excavations diaries Scientific publications Thesis

reports

Topographic placements Plans Sections Prospects

Digital photos Analogic photos Slides

maps pictures administrative

documentation

Delivery documentation Request for an opinion Concessions clearance Branded Opinion conference services Notice of commencement of works Authorization launch investigation

Hierarchic model

Model chosen: RDBMS (Relational DataBase Management System)

Relational model

Logic models

TOWARDS A 3D DATABASE : STRUCTURING A DATABASE FOR ARCHITECTURE AND ARCHAEOLOGY

Tema di ricerca dottorale e sue basi di partenza Research activities conducted

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

STRUCTURE:

1.Palermo’ s sollazzi : IDENTIFICATION DATA LOCATION 2.Parts of sollazzo/3.Building: IDENTIFICATION DATA LOCATION TIMELINE

TYPOLOGICAL DATA CONSTRUCTION TECNIQUES CONDITION OF THE BUILDING BIBLIOGRAPHY 4.Areas of part of sollazzo: IDENTIFICATION DATA

5.Rooms of the building: IDENTIFICATION DATA HISTORICAL NOTES CONSTRUCTION TECNIQUES CONDITION OF THE ROOM BIBLIOGRAPHY

Sources for structuring DB fields: - Catalog cards by ICCD - Method of cataloguing by SITAR - Specific analysis of the study case

6.Architectural element: IDENTIFICATION DATA LOCATION AND TIMELINE CONSTRUCTION TECNIQUES AND CONDITION RESTAURATION

BIBLIOGRAPHY

7.Archaeology artifact: IDENTIFICATION DATA LOCATION AND RELATIONSHIPS EXCAVATION

HISTORICAL NOTES TECNIC./MORPHOL. DATA CONDITION OF THE FIND PROPERTY RELATIONS AND OTHER

Hierarchic decomposition of the artifacts aimed at 3D modeling and structuring the DB in PostgreSQL

Tema di ricerca dottorale e sue basi di partenza Research activities conducted

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

3D MODELING WITH BLENDER

Tema di ricerca dottorale e sue basi di partenza Research activities conducted

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

3D Model of the Castle (iWitness) Data from integrated relief exported in .dxf

3D modeling (Blender)

THE CASTLE OF MAREDOLCE IN PALERMO

Application of photo-plans as textures to 3d model (Blender)

Tema di ricerca dottorale e sue basi di partenza Research activities conducted

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

Integrated relief of the Castle of Maredolce

Topographic

GPS

Photogrammetric

Laserscanner

3D modeling of the Castle of Maredolce

Data from the relief(CAD and Raster)

Esportation of the 3D model to Acrobat

U3D format

(through an additional plugin of Blender)

Tema di ricerca dottorale e sue basi di partenza Research activities conducted

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

3D PDF : ACROBAT DATABASE CONNECTIVITY (ADBC)

The ADBC (Acrobat DataBase Connectivity) plug-in

allows the connection to Database through some

Javascript scripts. Javascript also allows to run queries on

the Database and to insert or upgrade data in its tables.

LIMITS

The only limitation is that ADBC is a Windows function and

requires the Open Database Connectivity (ODBC) from

Microsoft.

Tema di ricerca dottorale e sue basi di partenza Research activities conducted

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

3D PDF: THE DATABASE IN PostgreSQL

Tema di ricerca dottorale e sue basi di partenza Research activities conducted

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

3D PDF : THE DATABASE IN PostgreSQL

Tema di ricerca dottorale e sue basi di partenza Research activities conducted

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

.obj _ It’s allows the exportation to 3D PDF of mesh, materials, textures, mantaining a good quality of the mesh produced in Blender.

.3ds _ It’s allows the exportation to 3D PDF of mesh and materials, but not of textures. The quality of the mesh importated is better than the one obtained in .obj format.

.wrml2 _ It’s allows the exportation to 3D PDF of mesh and materials, but not of textures. The quality of the mesh imported is unacceptable.

The .3ds format has been choosen for 3D models visualization (just in SOLID).

Texturized models are exportable just in .U3D format, instead.

File formats to export 3D models from Blender to 3D PDF

Tema di ricerca dottorale e sue basi di partenza Research activities conducted

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

Implementation of Cultural Heritage 3D information systems

APPLICATION: 3D PDF The system implemented is based on the integration between a 3D database and a 3D model, made queryable through an ODBC connection and shareable on the web. Inside this system, 3D model's graphic description is associated to the semantic information, stored in a RDBMS (Relational DataBase Management System). In the applications, the model is incorporated inside a 3D PDF. It allows both the 3D visualization of architectural or archaeological objects and some interactive operactions through some functions of its.

Tema di ricerca dottorale e sue basi di partenza Research activities conducted

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

3D PDF : THE JAVASCRIPT LANGUAGE

Tema di ricerca dottorale e sue basi di partenza Research activities conducted

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

3D PDF : THE CASTLE OF MAREDOLCE – Palermo’s sollazzi

Tema di ricerca dottorale e sue basi di partenza Research activities conducted

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

Tema di ricerca dottorale e sue basi di partenza Research activities conducted 3D PDF : THE CASTLE OF MAREDOLCE – Parts of sollazzo

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

3D PDF : THE CASTLE OF MAREDOLCE – Areas of part of sollazzo

Tema di ricerca dottorale e sue basi di partenza Research activities conducted

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

3D PDF : THE CASTLE OF MAREDOLCE – Rooms of the building

Tema di ricerca dottorale e sue basi di partenza Research activities conducted

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

Tema di ricerca dottorale e sue basi di partenza Research activities conducted 3D PDF : THE CASTLE OF MAREDOLCE – Rooms of the building

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

Tema di ricerca dottorale e sue basi di partenza Research activities conducted 3D PDF : THE CASTLE OF MAREDOLCE – Architectural element

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

3D PDF : THE CASTLE OF MAREDOLCE – Archaeology artifact

Tema di ricerca dottorale e sue basi di partenza Research activities conducted

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

3D PDF FUNCTIONS: 3D VISUALIZATIONS

Tema di ricerca dottorale e sue basi di partenza Research activities conducted

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

3D PDF FUNCTIONS : 3D VISUALIZATION AND BIDIRECTIONAL INTERACTIVITY BETWEEN MODEL AND DB

Tema di ricerca dottorale e sue basi di partenza Research activities conducted

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

3D PDF FUNCTIONS : VISUALIZATION OF SECTIONS

Tema di ricerca dottorale e sue basi di partenza Research activities conducted

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

3D PDF FUNCTIONS : 3D NAVIGATION

Tema di ricerca dottorale e sue basi di partenza Research activities conducted

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

3D PDF FUNCTIONS : 3D NAVIGATION, VIEW OPTIONS AND BIDIRECTIONALITY OF THE SYSTEM

Tema di ricerca dottorale e sue basi di partenza Research activities conducted

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

Thesaurus - Construction of models for storing data

concerning Cultural Heritage (also in GIS environment);

- Construction of conceptual models for describing Archaeological and Monumental Heritage (aimed at Cultural Heritage fruition by different target users); - Construction of a platform for storing and consult on line 3D model and related data (es. Open SceneGraph).

Development perspectives of the research:

Tema di ricerca dottorale e sue basi di partenza Development perspectives

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

Thesaurus

developing a conceptual and a logic model (and a physical 3D model)

developing an access mode to 3D information

developing a graphic user interface for the information system-user interaction

Research and implementation of applications for:

sharing models on line

other...

Tema di ricerca dottorale e sue basi di partenza Development perspectives

Geographic Free and Open Source Systems for multimedia fruition of Cultural Heritage Andrea Scianna, Susanna Gristina – GISLab IBAM-CNR/DICAM-UNIPA

Andrea Scianna, Susanna Gristina

[email protected], [email protected]

GEOGRAPHIC FREE AND OPEN SOURCE SYSTEMS FOR MULTIMEDIA FRUITION OF

CULTURAL HERITAGE

THANKS FOR YOUR ATTENTION!