Creating and sharing knowledge for telecommunications

Project: Plenoptic imaging for skin lesion assessment

Acronym: PlenoISLA
Main Objective:
This project proposes the development and implementation of new imaging techniques for non-invasive skin surface characterization, based on recent light field imaging technology. The main objective is to obtain a new set of 3D-based quantitative markers associated to physiological processes of the skin, allowing the characterization of its morphological and functional structure, that can then be used as markers in evolution and prognosis in Dermatology studies. Based on the obtained skin 3D characteristics, new patterns of dermoholoscopy will be considered, leading to the definition of clusters of features and dermoholoscopic patterns to be used in the context of automatic learning algorithms, in particular within the scope of "Deep Learning". Besides the computational analysis, new techniques for acquisition and compression of the light field images will also be addressed, as well as a database with skin lesion plenoptic images that will be created for the scientific community.
Reference: PTDC/EEI-TEL/28325/2017
Funding: FCT/POCI, P2020
Start Date: 25-07-2018
End Date: 31-12-2021
Team: Sérgio Manuel Maciel de Faria, Pedro Antonio Amado Assunção, Pedro Miguel Marques Pereira, João Miguel Pereira da Silva Santos, Rui Miguel Leonel Lourenco, João Oliveira Parracho, Miguel Oliveira Santos, Lucas Arrabal Thomaz, Rui Manuel Fonseca Pinto, Luís Miguel de Oliveira Pegado de Noronha e Távora, Francisco Ferreira Cunha, Miguel Santos, Cristian Perra
Groups: Multimedia Signal Processing – Lr
Partners: Centro Hospitalar de Leiria
Local Coordinator: Sérgio Manuel Maciel de Faria
...
Links: http://www.it.pt/AutomaticPage?id=3459

Associated Publications
  • 2Boock Chapters
  • J Debono, M. Domański, S.M.M. Faria, K. Klimaszewski, L. Lucas, Nuno M. M. Rodrigues, KW Wegner, Efficient Depth-Based Coding, Chapter in, 3D Visual Content Creation, Coding and and Delivery, Pedro Assunção and Atanas Gotchev, Springer International Publishing AG Springer Nature, New York, 2019
  • S.M.M. Faria, M. Domański, T. Grajek, C. Conti, J Debono, P. T. Kovács, L. Lucas, P. Nunes, C. Perra, Nuno M. M. Rodrigues, M. Sjöström, L. D. Soares, O. Stankiewicz, Emerging Imaging Technologies: Trends and Challenges, Chapter in, 3D Visual Content Creation, Coding and Delivery, Pedro Assunção and Atanas Gotchev, Springer International Publishing AG Springer Nature, New York, 2019
  • 10Papers in Journals
  • Pedro M. M. Pereira, L. A. Thomaz, L.M. Távora, P.A. Assunção, R. Pinto, R. Paiva, S.M.M. Faria, Multiple Instance Learning Using 3D Features for Melanoma Detection, IEEE Access, Vol. 10, No. 0, pp. 76296 - 76309, July, 2022,
    | Abstract
    | BibTex
  • João M. Santos, L. A. Thomaz, P.A. Assunção, L. A. S. C. Cruz, L.M. Távora, S.M.M. Faria, Hierarchical lossless coding of light fields with improved random access, Signal Processing: Image Communication, Vol. 105, No. 0, pp. 116687 - 116687, March, 2022,
    | Abstract
    | Full text (PDF 8 MBs) | BibTex
  • Pedro M. M. Pereira, L. A. Thomaz, L.M. Távora, P.A. Assunção, R. Pinto, R. Paiva, S.M.M. Faria, Melanoma Classification using Light-Fields with Morlet Scattering Transform and CNN: surface depth as a valuable tool to increase detection rate, Medical Image Analysis, Vol. 75, No. 75, pp. 102254 - 102254, January, 2022,
    | Abstract
    | BibTex
  • R. Lourenço, L.M. Távora, P.A. Assunção, L. A. Thomaz, R. Pinto, S.M.M. Faria, Enhancement of light field disparity maps by reducing the silhouette effect and plane noise, Multidimensional Systems and Signal Processing, Vol., No., pp. -, January, 2022,
    | Abstract
    | BibTex
  • João M. Santos, L. A. Thomaz, P.A. Assunção, L. A. S. C. Cruz, L.M. Távora, S.M.M. Faria, Lossless Coding of Light Fields based on 4D Minimum Rate Predictors, IEEE Transactions on Image Processing, Vol. 31, No. 1, pp. 1708 - 1722, January, 2022,
    | Abstract
    | Full text (PDF 18 MBs) | BibTex
  • R. Monteiro, Nuno M. M. Rodrigues, S.M.M. Faria, P. Nunes, Light field image coding with flexible viewpoint scalability and random access, Signal Processing: Image Communication, Vol. 94, No. -, pp. 116202 - 116202, May, 2021,
    | Abstract
    | BibTex
  • R. Monteiro, Nuno M. M. Rodrigues, S.M.M. Faria, P. Nunes, Light Field Image Coding Based on Hybrid Data Representation, IEEE Access, Vol. 8, No. -, pp. 115728 - 115744, June, 2020 | BibTex
  • L. A. Thomaz, P.A. Assunção, L.M. Távora, S.M.M. Faria, Integer DCT Approximation With Arbitrary Size and Adjustable Precision, IEEE Signal Processing Letters, Vol. 27, No. -, pp. 965 - 969, May, 2020,
    | Abstract
    | Full text (PDF 242 KBs) | BibTex
  • Pedro M. M. Pereira, R. Pinto, R. Paiva, P.A. Assunção, L.M. Távora, L. A. Thomaz, S.M.M. Faria, Dermoscopic skin lesion image segmentation based on Local Binary Pattern Clustering: Comparative study, Biomedical Signal Processing and Control, Vol. 59, No. 101924, pp. 101924 - 101924, May, 2020,
    | Abstract
    | BibTex
  • Pedro M. M. Pereira, R. Pinto, R. Paiva, P.A. Assunção, L.M. Távora, L. A. Thomaz, S.M.M. Faria, Skin lesion classification enhancement using border-line features – The melanoma vs nevus problem, Biomedical Signal Processing and Control, Vol. 57, No. 57, pp. 101765 - 101765, March, 2020,
    | Abstract
    | BibTex
  • 19Papers in Conferences
  • Pedro M. M. Pereira, L. A. Thomaz, L.M. Távora, P.A. Assunção, R. Pinto, R. Paiva, S.M.M. Faria, Skin lesion classification using features of 3D border lines, Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Conference online, October, 2021,
    | Abstract
    | BibTex
  • S.M.M. Faria, R. Lourenço, L. A. Thomaz, E. Silva, P.A. Assunção, L.M. Távora, Light Field Disparity Map Enhancement with Morphological Filtering, Telecoms Conference ConfTELE, Conference online, February, 2021 | BibTex
  • Pedro M. M. Pereira, L. A. Thomaz, L.M. Távora, P.A. Assunção, R. Pinto, R. Paiva, S.M.M. Faria, Skin Lesion Classification using Bag-of-3D-Features, Conf. on Telecommunications - ConfTele, Conference online, February, 2021,
    | Abstract
    | Full text (PDF 213 KBs) | BibTex
  • J. Filipe, P.A. Assunção, L.M. Távora, R. Pinto, L. A. Thomaz, S.M.M. Faria, Improved Patch-based View Rendering for Focused Plenoptic Cameras with Extended Depth-of-Field, European Signal Processing Conference EUSIPCO, Conference online, January, 2021,
    | Abstract
    | Full text (PDF 318 KBs) | BibTex
  • L. A. Thomaz, João M. Santos, P.A. Assunção, L.M. Távora, S.M.M. Faria, DISPARITY COMPENSATION OF LIGHT FIELDS FOR IMPROVED EFFICIENCY IN 4D TRANSFORM-BASED ENCODERS, Visual Communications and Image Processing - VCIP, Macau, China, December, 2020 | BibTex
  • L. A. Thomaz, R. Lourenço, D. R. Castillo, P.A. Assunção, L.M. Távora, S.M.M. Faria, 4D Light Field Disparity Map estimation using Krawtchouk Polynomials, International Conference on Image Processing Theory, Tools and Applications IPTA, Paris, France, November, 2020 | BibTex
  • S.M.M. Faria, L. A. Thomaz, L.M. Távora, P.A. Assunção, R. Pinto, F. Cunha, Robust depth estimation from multi-focus plenoptic images, IEEE International Conference on Image Processing ICIP, Abu Dhabi, United Arab Emirates, October, 2020,
    | Abstract
    | BibTex
  • R. Monteiro, P. Nunes, S.M.M. Faria, Nuno M. M. Rodrigues, Optimized Reference Picture Selection for Light Field Image Coding, European Signal Processing Conference EUSIPCO, La Coruna, Spain, Vol., pp. - https://doi.org/10.23919/EUSIPCO.2019.8902555, September, 2019,
    | Abstract
    | BibTex
  • S.M.M. Faria, J. F, Pedro M. M. Pereira, L.M. Távora, P.A. Assunção, M. Santos, R. Pinto, F. Santiago, V. Dominguez, M. Henrique, Light Field Image Dataset of Skin Lesions, IEEE IEEE International Engineering in Medicine and Biology Conference IEEE EMBS, Berlim, Germany, July, 2019,
    | Abstract
    | BibTex
  • L. A. Thomaz, João M. Santos, P. Astola, S.M.M. Faria, P.A. Assunção, M. Carvalho, E. Silva, C.L.P. Pagliari, I. Tabus, M. Pereira, GOA Alves, F. Pereira, V. Testoni, P. Freitas, I. Seidel, Visually Lossless Compression of Light Fields, EURASIP European Light Field Imaging Workshop ELFI, Borovets, Bulgaria, June, 2019,
    | Abstract
    | BibTex
  • João M. Santos, P.A. Assunção, L. A. S. C. Cruz, L.M. Távora, R. Pinto, S.M.M. Faria, Rate-Complexity Trade-Off in Minimum Rate Predictors Light Field Lossless Encoding, EURASIP European Light Field Imaging Workshop ELFI, Borovets, Bulgaria, June, 2019,
    | Abstract
    | BibTex
  • R. Lourenço, P.A. Assunção, L.M. Távora, L. A. Thomaz, R. Pinto, S.M.M. Faria, Edge reconstruction method to improve depth estimation from light fields, EURASIP European Light Field Imaging Workshop ELFI, Borovets, Bulgaria, June, 2019,
    | Abstract
    | BibTex
  • S.M.M. Faria, M. Santos, P.A. Assunção, L.M. Távora, L. A. Thomaz, Pedro M. M. Pereira, R. Pinto, F. Santiago, V. Dominguez, M. Henrique, Dermatological Imaging using a Focused Plenoptic Camera: the SKINL2 Light Field Dataset, Conf. on Telecommunications - ConfTele, Lisboa, Portugal, June, 2019,
    | Abstract
    | Full text (PDF 16 MBs) | BibTex
  • L. Lucas, S.M.M. Faria, Nuno M. M. Rodrigues, L. A. S. C. Cruz, Lossless Video Compression Using Minimum Rate Predictors and Volumetric Optimisation, Conf. on Telecommunications - ConfTele, Lisboa, Portugal, June, 2019,
    | Abstract
    | Full text (PDF 219 KBs) | BibTex
  • Pedro M. M. Pereira, R. Pinto, R. Paiva, L.M. Távora, P.A. Assunção, S.M.M. Faria, Accurate Segmentation of Dermoscopic Images based on Local Binary Pattern Clustering, IEEE International Convention on Information and Communication Technology, Electronics and Microelectronics MIPRO, Opatija, Croatia, Vol. 1, pp. 314 - 319, May, 2019,
    | Abstract
    | BibTex
  • João M. Santos, P.A. Assunção, L. A. S. C. Cruz, L.M. Távora, R. Pinto, S.M.M. Faria, Lossless compression of Light Fields using multi-reference Minimum Rate Predictors, IEEE Data Compression Conference - DCC, Snowbird, Utah, United States, March, 2019,
    | Abstract
    | Full text (PDF 6 MBs) | BibTex
  • Pedro M. M. Pereira, L.M. Távora, R. Pinto, R. Paiva, P.A. Assunção, S.M.M. Faria, Image Segmentation using Gradient-based Histogram Thresholding for Skin Lesion Delineation, INSTICC International Conference on Bioimaging Bioimaging 2019, Praga, Czech Republic, February, 2019,
    | Abstract
    | BibTex
  • R. Lourenço, P.A. Assunção, L.M. Távora, R. Pinto, S.M.M. Faria, Silhouette Enhancement in Light Field Disparity Estimation Using the Structure Tensor, IEEE International Conf. on Image Processing - ICIP, Athens, Greece, Vol., pp. 2580 - 2584, October, 2018,
    | Abstract
    | BibTex
  • Pedro M. M. Pereira, R. Pinto, R. Paiva, L.M. Távora, P.A. Assunção, S.M.M. Faria, Transfer Learning of ImageNet Neural Network for Pigmented Skin Lesion Detection, Portuguese Conf. on Pattern Recognition - RecPad, Coimbra, Portugal, October, 2018,
    | Abstract
    | BibTex
  • 2Theses
  • Improved Image Rendering for Focused Plenoptic Cameras with Extended Depth-of-field, Instituto Politécnico de Leiria, MSc Student, Jose Nunes dos Santos Filipe, Supervisor: S.M.M. Faria, Co-supervisor: L.M. Távora, out-2016 - jan-2019
  • Structure Tensor-based Depth Estimation from Light Field Images, Instituto Politécnico de Leiria, MSc Student, Rui Miguel Leonel Lourenco, Supervisor: P.A. Assunção, Co-supervisor: L.M. Távora, out-2016 - jan-2019