CybAI news

arXiv:2407.11300v1 Announce Type: new Abstract: Context-aware emotion recognition (CAER) is a complex and significant task that requires perceiving emotions from various contextual cues. Previous approaches primarily focus on designing sophisticated architectures to extract emotional cues from images. However, their knowledge is confined to specific training datasets and may reflect the subjective emotional biases of the annotators. Furthermore, acquiring large amounts of labeled data is often challenging in real-world applications. In this paper, we systematically explore the potential of leveraging Large Vision-Language Models (LVLMs) to empower the CAER task from three paradigms: 1) We fine-tune LVLMs on two CAER datasets, which…

arXiv:2407.11008v1 Announce Type: new Abstract: Figures are essential channels for densely communicating complex ideas in scientific papers. Previous work in automatically generating figure captions has been largely unsuccessful and has defaulted to using single-layer LSTMs, which no longer achieve state-of-the-art performance. In our work, we use the SciCap datasets curated by Hsu et al. and use a variant of a CLIP+GPT-2 encoder-decoder model with cross-attention to generate captions conditioned on the image. Furthermore, we augment our training pipeline by creating a new dataset MetaSciCap that incorporates textual metadata from the original paper relevant to the figure, such as the title,…

(Mr. Squid/Shutterstock) Nothing stays still for long in the world of GenAI. The system prompts you’ve written for GPT-4 or Llama-3 8B give you one answer today, but may tell you something different tomorrow. This is the danger of a condition known as prompt lock-in. System prompts set the conditions and the context for the answer the user expects from the large language model (LLM). Combined with other techniques, such as fine-tuning and retrieval-augmented generation (RAG), system prompts are a critical tool for getting the most from an LLM. However, system prompts don’t work like normal computer programs, says Luis…