Alvaro E. Prieto | i3 lab

A multi-criteria decision support system to evaluate the effectiveness of training courses on citizens' employability

Wed, 01 Jan 2025 00:00:00 +0000

Analysis of ChatGPT Performance in Computer Engineering Exams

Mon, 25 Mar 2024 00:00:00 +0000

JENUI 2023: best paper

Thu, 06 Jul 2023 00:00:00 +0000

On November 30, 2022, OpenAI introduced ChatGPT. Like most of us, we were surprised 🤯 with its incredible capabilities. From the first moment, we wondered what impact it would have on the different facets of our day-to-day life: in Computer Engineering, research, and teaching. Based on an idea from our colleague Roberto, we decided to focus on the latter.

The result of several months of effort is our work “Impact of ChatGPT in the evaluation methods of a Computer Engineering degree “, which we presented to the JENUI of 2023 and for which we have been awarded the prize for best paper of the conference. In this edition, dominated by ChatGPT (something that has kept some speakers awake at night), the paper “To rival or not: analysis of Wooclap’s competition mode based on performance and audio processing “, by our colleagues from the University of Murcia, was also awarded.

Here you can see Roberto presenting our experience to the rest of the attendees (about 10 minutes plus question time):

}

We will share the proceedings as soon as they are published so you can read the work and give us your feedback. In the meantime, here is the abstract:

Generative Artificial Intelligence has undergone an essential evolution during the last years and especially in 2022. One of the intelligence that has caused the most buzz in academia is ChatGPT, which provides an interface that significantly simplifies the productive use of a large language model. These language models can parse and generate text with great speed and quality. These capabilities could have a relevant impact on teaching-learning methodologies and assessment methods. In order to analyze the possible impact of ChatGPT on assessment methods, in this work, ChatGPT’s ability to solve the exams of 15 Software Engineering subjects of a Computer Engineering degree has been tested. The results show that ChatGPT could noticeably impact the assessment methods; it can overcome many questions and problems of different natures in multiple subjects. As a fundamental contribution, a detailed study of the results by type of questions and problems is provided, which allows us to establish recommendations to be taken into account in the design of assessment methods.

Are you interested in the subject? Do you want to collaborate with us? Contact us, and we’ll talk.

Update: You can read the cited work right here.

Impacto de ChatGPT en los métodos de evaluación de un grado de Ingeniería Informática

Wed, 05 Jul 2023 00:00:00 +0000

A Model-Driven Approach for Systematic Reproducibility and Replicability of Data Science Projects

Tue, 28 Jun 2022 00:00:00 +0000

CompareML: A Novel Approach to Supporting Preliminary Data Analysis Decision Making

Wed, 01 Jun 2022 00:00:00 +0000

SimulateIoT: Domain Specific Language to Design, Code Generation and Execute IoT Simulation Environments

Fri, 25 Jun 2021 00:00:00 +0000

Applying data driven decision making to rank vocational and educational training programs with TOPSIS

Mon, 01 Mar 2021 00:00:00 +0000

Framework for Prioritization of Open Data Publication: An Application to Smart Cities

Fri, 01 Jan 2021 00:00:00 +0000

Towards a Conceptual Framework for the Specification of Reproducible and Replicable Data Analysis Projects

Fri, 01 Jan 2021 00:00:00 +0000

Towards the use of Data Engineering, Advanced Visualization techniques and Association Rules to support knowledge discovery for public policies

Fri, 01 Jan 2021 00:00:00 +0000

Business Process Execution From the Alignment Between Business Processes and Web Services: A Semantic and Model-Driven Modernization Process

Wed, 01 Jan 2020 00:00:00 +0000

A High-Frequency Data-Driven Machine Learning Approach for Demand Forecasting in Smart Cities

Sat, 01 Jun 2019 00:00:00 +0000

A Hierarchical Adaptation Method for Administrative Workflows

Tue, 01 Jan 2019 00:00:00 +0000

Aligning Business Processes With the Services Layer Using a Semantic Approach

Tue, 01 Jan 2019 00:00:00 +0000

Supporting open dataset publication decisions based on Open Source Software reuse

Mon, 01 Jan 2018 00:00:00 +0000

MigraSOA: Migration of legacy web applications to service oriented architectures (SOA)

Sun, 01 Jan 2017 00:00:00 +0000

An Ontological Approach to the Hierarchical Adaptation of Workflows

Wed, 01 Jul 2015 00:00:00 +0000

Defining Reusable Administrative Processes using a Generic Ontology

Thu, 01 Mar 2012 00:00:00 +0000

Use of Ontologies as Representation Support of Workflows Oriented to Administrative Management

Tue, 01 Sep 2009 00:00:00 +0000