Image captioning for Brazilian Portuguese using GRIT model
Rafael Silva de Alencar, William Alberto Cruz Casta\~neda and, Marcellus Amadeus
TL;DR
This paper adapts the GRIT Transformer-based model for image captioning to the Brazilian Portuguese language, demonstrating its effectiveness in generating captions in this language.
Contribution
It introduces a novel adaptation of the GRIT model for Brazilian Portuguese, enabling image captioning in this language.
Findings
Effective caption generation in Brazilian Portuguese
Utilizes visual features for improved captions
Adapts Transformer architecture for language-specific task
Abstract
This work presents the early development of a model of image captioning for the Brazilian Portuguese language. We used the GRIT (Grid - and Region-based Image captioning Transformer) model to accomplish this work. GRIT is a Transformer-only neural architecture that effectively utilizes two visual features to generate better captions. The GRIT method emerged as a proposal to be a more efficient way to generate image captioning. In this work, we adapt the GRIT model to be trained in a Brazilian Portuguese dataset to have an image captioning method for the Brazilian Portuguese Language.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsMultimodal Machine Learning Applications · Subtitles and Audiovisual Media