Category

Research

Organization

Signa_Lab ITESO (for INE México, 2024)

Debate INE 2024. Selection of citizens questions for the 1st Presidential Debate of Mexico.

Selecting the 108 citizen questions out of 24,000 for Mexico's 1st Presidential Debate of 2024.

Processing and selection of question pool, out of 24,000 questions send by citizens to the National Electoral Institute of Mexico (INE) to be used by the moderators of the 1st Presidential Debate in Mexico's 2024 electoral process. This selection followed closely the methodology and results requested by the institution to retrieve 90 random questions (15 per theme) and 18 most recurrent questions (top 3 per topic).

Visit code repository

Large Project Gallery Image #1
Large Project Gallery Image #1
Large Project Gallery Image #1

Open, traceable and replicable selection of crowsourced questions, using emerging technologies and human qualitative assessment.

Following the requested methodology, custom Python code was developed in local notebooks (Jupyter) and locally hosted models (intfloat/multilingual-e5-large-instruct) to generated text embeddings (sentence transformers), reduce their dimensionality (UMAP) and cluster them (k-means) to extend human qualitative assessment of semantic patterns within questions, complemented by other stablished NLP tecnniques (TF-IDG, ngrams).

  • The image featured in the carousel #1
  • The image featured in the carousel #2
  • The image featured in the carousel #3
  • The image featured in the carousel #4
  • The image featured in the carousel #1
  • The image featured in the carousel #2
  • The image featured in the carousel #3
  • The image featured in the carousel #4
  • The image featured in the carousel #1
  • The image featured in the carousel #2
  • The image featured in the carousel #3
  • The image featured in the carousel #4

Tools:

Data cleaning, language processings and selection: Python, Jupyter Notebook, Sentence-Transformers, UMAP, Scikit-Lean, NLTK, Plotly, Seaborn, Matplotlib Langage model: intfloat/multilingual-e5-large-instruct Other open tools: OpenRefine, LibreOffice, AntConc, Gephi

Visit institutional repository and report

Credits:

A project commisioned to Signa_Lab ITESO by INE Mexico. Collaborated in supervising technological development, documentation and data visualization. Full credits in code repository*

View more projects

Create a free website with Framer, the website builder loved by startups, designers and agencies.