Publication:
Evolutionary Optimization of Instruction-Tuned Large Language Model Inference Parameters for Spanish Text Simplification
| cris.virtual.department | #PLACEHOLDER_PARENT_METADATA_VALUE# | |
| cris.virtual.orcid | 0000-0002-5145-872X | |
| cris.virtualsource.department | a6e15b57-cd91-48e5-9630-242b1b7129de | |
| cris.virtualsource.orcid | a6e15b57-cd91-48e5-9630-242b1b7129de | |
| dc.contributor.author | Perez-Rojas, Nelson | |
| dc.contributor.author | Xie-Li, Danny | |
| dc.contributor.author | Solis, Martin | |
| dc.contributor.author | Calderon-Ramirez, Saul | |
| dc.contributor.author | Rojas Gonzalez, Sebastian | |
| dc.contributor.author | Ortiz-Ruiz, Victor | |
| dc.date.accessioned | 2026-11-17T10:29:15Z | |
| dc.date.available | 2026-11-17T10:29:15Z | |
| dc.date.createdwos | 2026 | |
| dc.date.issued | 2026 | |
| dc.description.abstract | Large Language Models (LLM) have become valuable tools for automatic text simplification, yet their output quality is highly sensitive to inference-time parameters such as temperature, repetition penalty, top-p, and top-k. These parameters are typically set heuristically rather than systematically optimized. In this work, we apply Covariance Matrix Adaptation Evolution Strategy (CMA-ES) to identify high-performing inference configurations for an instruction-tuned Large Language Model (LLM) fine-tuned for Spanish Text Simplification (TS) on the Financial Education Corpus IN SpAnish (FEINA) benchmark. Using System output Against References and against the Input sentence (SARI) as the optimization objective and Sentence Bidirectional Encoder Representations from Transformers (SBERT) as a monitoring metric, CMA-ES converges in 9 of 25 generations, improving test-set SARI from 36.57 (default) to 38.87 (+6.3%) while increasing SBERT from 0.85 to 0.88. Grid search analysis reveals that repetition penalty and temperature are the dominant factors influencing simplification quality, while top-k and maximum tokens have negligible effects. The strong positive correlation between SARI and SBERT across all 2,500 evaluated configurations provides empirical support for the single-objective approach within the studied setting. Our framework offers a replicable methodology for inference parameter optimization applicable to Spanish and other under-resourced languages in Latin American Natural Language Processing (NLP) contexts. | |
| dc.description.wosFundingText | The authors express their gratitude to the Escuela de Ciencias del Lenguaje and the Vicerrectoria de Investigacion y Extension at the Instituto Tecnologico de Costa Rica (TEC). This research was conducted under the framework of project ID 1470018, titled "Evaluacion de modelos de inteligencia artificial en simplificacion automatica de textos en espanol para personas con discapacidades visuales." Additionally, the authors acknowledge the computational resources provided through a machine allocation on the Kabre supercomputer at the Costa Rica National High Technology Center and the Scientific Cluster of the University of Costa Rica, which contributed to the completion of this work. | |
| dc.identifier.doi | 10.1145/3795101.3814720 | |
| dc.identifier.isbn | 979-8-4007-2488-6 | |
| dc.identifier.uri | https://imec-publications.be/handle/20.500.12860/60834 | |
| dc.language.iso | eng | |
| dc.provenance.editstepuser | greet.vanhoof@imec.be | |
| dc.publisher | ASSOC COMPUTING MACHINERY | |
| dc.source.beginpage | 1465 | |
| dc.source.conference | Genetic and Evolutionary Computation Conference Companion - GECCO | |
| dc.source.conferencedate | 2026-07-13 | |
| dc.source.conferencelocation | San Jose, Costa Rica | |
| dc.source.endpage | 1473 | |
| dc.source.journal | PROCEEDINGS OF THE 2026 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE, GECCO 2026 COMPANION | |
| dc.source.numberofpages | 9 | |
| dc.title | Evolutionary Optimization of Instruction-Tuned Large Language Model Inference Parameters for Spanish Text Simplification | |
| dc.type | Proceedings paper | |
| dspace.entity.type | Publication | |
| imec.internal.crawledAt | 2026-11-14 | |
| imec.internal.source | crawler | |
| imec.internal.wosCreatedAt | 2026-11-14 | |
| Files | Original bundle
| |
| Publication available in collections: |