Personal photograph collections ontology development through thematic tags

Published: May 22, 2024
Keywords:
Ontology mapping Dynamic Ontology development Personal photography Photo management Digital photo organization Photo retrieval
Vasiliki Manoli
Department of Archival, Library & Information Studies, University of West Attica, Athens, Greece
Ioannis Triantafyllou
Department of Archival, Library & Information Studies, University of West Attica, Athens, Greece
Abstract

Purpose - The number and the variety of photos have grown to a great extent as they can be created anytime, everywhere and spontaneously. Searching for a particular photo file has become a boring, repetitive and tedious activity. The application of an ontology to express the user profile characteristics relation with the narrative, spatial, time and other types of information of the collected photos becomes imperative.


Design/methodology/approach -The work presented in our article includes the development of a personal photograph collections ontology (MyOntoPhotos) specialising in documenting the metadata of the topics that end-users prefer mostly to capture with their devices. An extensive survey, among 650 participants, was conducted with the use of an online questionnaire comprised of semi-closed questions, following the Likert scale and the scale category grading.


Findings -The ontology created was based on the results of an extensive survey aiming to identify thematic areas of interest, apart from spatial and temporal information, as other similar efforts did in the past. It is mentionable that the survey results proved the majority of the responders selected 22 thematic tags.


Originality/value -Based on the research findings an innovative concept for a mobile application is presented, focusing on enhancing end-users photo collections organizing and retrieval functions.

Article Details
  • Section
  • Research Articles
Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

Copyright Notice

Authors who publish with JIIM agree to the following terms:

  1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution Non-Commercial License that allows others to share the work with:
  2. An acknowledgment of the work's authorship and initial publication in this journal.
  3. Authors are permitted and encouraged to post their work online (preferably in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.
References
Viana, W., Bringel Filho, J., Gensel, J., Oliver, M. V., & Martin, H. (2007). PhotoMap–Automatic Spatiotemporal Annotation for Mobile Photos. In: International Symposium on Web and Wireless Geographical Information Systems (pp. 187-201). Springer Berlin Heidelberg.
Viana, W., Miron, A. D., Moisuc, B., Gensel, J., Villanova-Oliver, M., & Martin, H. (2011). Towards the semantic and context-aware management of mobile multimedia. Multimedia Tools and Applications, 53(2), 391-429.
Van House, N. A. (2009). Collocated photo sharing, story-telling, and the performance of self. International Journal of Human-Computer Studies, 67(12), 1073-1086.
Latif, K., Mustofa, K., & Tjoa, A. M. (2006). An approach for a personal information management system for photos of a lifetime by exploiting semantics. In: International Conference on Database and Expert Systems Applications (pp. 467-477). Springer Berlin Heidelberg.
Datia, N., Pires, J. M., & Correia, N. (2016). Time and space for segmenting personal photo sets. Multimedia Tools and Applications, 1-33.
Frohlich, D., & Fennell, J. (2007). Sound, paper and memorabilia: resources for a simpler digital photography. Personal and Ubiquitous Computing, 11(2), 107-116.
Monaghan, F., & O'Sullivan, D. (2006). Automating photo annotation using services and ontologies. In: 7th International Conference on Mobile Data Management (MDM'06) (pp. 79-79). IEEE.
Do, T. M. T., Blom, J., & Gatica-Perez, D. (2011). Smartphone usage in the wild: a large-scale analysis of applications and context. In: Proceedings of the 13th international conference on multimodal interfaces (pp. 353-360). ACM.
Gruber, T. R. (1993). A translation approach to portable ontology specifications. Knowledge acquisition, 5(2), 199-220.
Paralic, J., &Kostial, I. (2003). Ontology-based information retrieval. Information and Intelligent Systems, Croatia, 23-28.
Kotis, K., Vouros, G. A., & Stergiou, K. (2006). Towards automatic merging of domain ontologies: The HCONE-merge approach. Web semantics: Science, services and agents on the world wide web, 4(1), 60-79.
Horrocks, I. (2008). Ontologies and the semantic web. Communications of the ACM, 51(12), 58-67.
Lanzenberger, M., Sampson, J. J., Rester, M., Naudet, Y., & Latour, T. (2008). Visual ontology alignment for knowledge sharing and reuse. Journal of Knowledge Management, 12(6), 102-120.
Jörgensen, C. (2003). Image Retrieval: Theory and Research, Scarecrow Press, Lanham, MD.
Enser, P. G., Sandom, C. J., Hare, J. S., & Lewis, P. H. (2007). Facing the reality of semantic image retrieval. Journal of Documentation, 63(4), 465-481.
Radley, A. (2010). What people do with pictures. Visual Studies, 25(3), 268-279.
Hare, J. S., Lewis, P. H., Enser, P. G., & Sandom, C. J. (2006). Mind the gap: another look at the problem of the semantic gap in image retrieval. In: Multimedia Content Analysis, Management, and Retrieval 2006 (Vol. 6073, p. 607309). International Society for Optics and Photonics.
Liu, Y., Xu, D., Tsang, I. W., & Luo, J. (2011).Textual query of personal photos facilitated by large-scale web data. IEEE transactions on pattern analysis and machine intelligence, 33(5), 1022-1036.
Tao, D., Tang, X., Li, X., & Wu, X. (2006). Asymmetric bagging and random subspace for support vector machines-based relevance feedback in image retrieval. IEEE transactions on pattern analysis and machine intelligence, 28(7), 1088-1099.
Ames, M., & Naaman, M. (2007). Why we tag: motivations for annotation in mobile and online media. In: Proceedings of the SIGCHI conference on Human factors in computing systems (pp. 971-980). ACM.
Marlow, C., Naaman, M., Boyd, D., & Davis, M. (2006). HT06, tagging paper, taxonomy, Flickr, academic article, to read. In: Proceedings of the 17th conference on Hypertext and hypermedia (pp. 31-40). ACM.
Highfield, T., & Leaver, T. (2015). A methodology for mapping Instagram hashtags. First Monday, 20(1), 1-11.
Ferré, S. (2007). Camelis: Organizing and browsing a personal photo collection with a logical information system. In: International Conference on Concept Lattices and Their Applications (Vol. 331, pp. 112-123).
De Figueirêdo, H. F., Lacerda, Y. A., de Paiva, A. C., Casanova, M. A., & de Souza Baptista, C. (2012). PhotoGeo: a photo digital library with spatial-temporal support and self-annotation. Multimedia Tools and Applications, 59(1), 279-305.
Graham, A., Garcia-Molina, H., Paepcke, A., & Winograd, T. (2002). Time as essence for photo browsing through personal digital libraries. In: Proceedings of the 2nd ACM/IEEE-CS joint conference on Digital libraries (pp. 326-335). ACM.
Toyama, K., Logan, R., & Roseway, A. (2003). Geographic location tags on digital images. In: Proceedings of the eleventh ACM international conference on Multimedia (pp. 156-166). ACM.
Bederson, B. B. (2001). PhotoMesa: a zoomable image browser using quantum treemaps and bubblemaps. In: Proceedings of the 14th annual ACM symposium on User interface software and technology (pp. 71-80). ACM. Personal photograph collections ontology development through thematic tags Journal of Integrated Information Management - Vol 03, No 01 34
Li, J., Lim, J. H., & Tian, Q. (2003). Automatic summarization for personal digital photos. In: Proceedings of the 2003 Joint Conference of the Fourth International Conference on Information, Communications and Signal Processing, 2003 and Fourth Pacific Rim Conference on Multimedia. (Vol. 3, pp. 1536-1540). IEEE.
Kindberg, T., Spasojevic, M., Fleck, R., & Sellen, A. (2005). The ubiquitous camera: An in-depth study of camera phone use. IEEE Pervasive Computing, 4(2), 42-50.
Van House, N. A., Davis, M., Takhteyev, Y., Ames, M., & Finn, M. (2004). The social uses of personal photography: methods for projecting future imaging applications. University of California, Berkeley, Working Papers, 3, 2005.
Bruneau, P., Pigeau, A., Gelgon, M., & Picarougne, F. (2008). Geo-temporal structuring of a personal image database with two-level variational-Bayes mixture estimation. In: International Workshop on Adaptive Multimedia Retrieval (pp. 127-139). Springer Berlin Heidelberg.
Cao, L., Luo, J., Kautz, H., & Huang, T. S. (2008). Annotating collections of photos using hierarchical event and scene models. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2008. (pp. 1-8). IEEE.
Cooper, M. L. (2011). Clustering geo-tagged photo collections using dynamic programming. In: Proceedings of the 19th ACM international conference on Multimedia (pp. 1025-1028). ACM.
Naaman, M., Paepcke, A., & Garcia-Molina, H. (2003). From where to what: Metadata sharing for digital photographs with geographic coordinates. In: OTM Confederated International Conferences" On the Move to Meaningful Internet Systems" (pp. 196-217). Springer Berlin Heidelberg.
Naaman, M., Harada, S., Wang, Q., Garcia-Molina, H., & Paepcke, A. (2004). Context data in geo-referenced digital photo collections. In: Proceedings of the 12th annual ACM international conference on Multimedia (pp. 196-203). ACM.
Ryu, D. S., Chung, W. K., & Cho, H. G. (2012). A hierarchical photo visualization system emphasizing temporal and color-based coherences. Multimedia Tools and Applications, 61(3), 523-550.
Van House, N., Davis, M., Takhteyev, Y., Good, N., Wilhelm, A., & Finn, M. (2004). From “what?” to “why?”: the social uses of personal photos. In: Proceedings of CSCW 2004
Cao, L., Luo, J., Kautz, H., & Huang, T. S. (2009).Image annotation within the context of personal photo collections using hierarchical event and scene models. IEEE Transactions on Multimedia, 11(2), 208-219.
Rodden, K., & Wood, K. R. (2003). How do people manage their digital photographs? In: Proceedings of the SIGCHI conference on Human factors in computing systems (pp. 409-416). ACM.
Boutell, M., & Luo, J. (2005). Beyond pixels: Exploiting camera metadata for photo classification. Pattern recognition, 38(6), 935-946.
Ransom, N., & Rafferty, P. (2011). Facets of user-assigned tags and their effectiveness in image retrieval. Journal of Documentation, 67(6), 1038-1066.
Creswell, J. W. (2011). Controversies in mixed methods research. The Sage handbook of qualitative research, 4, 269-284.
Schreiber, A. T., Dubbeldam, B., Wielemaker, J., & Wielinga, B. (2001). Ontology-based photo annotation. IEEE Intelligent systems, 16(3), 66-74.
Cristani, M., & Cuel, R. (2005). A survey on ontology creation methodologies. International Journal on Semantic Web and Information Systems (IJSWIS), 1(2), 49-69.