<tt>L2CEval</tt>: Evaluating Language-to-Code Generation Capabilities of Large Language Models

<tt>L2CEval</tt>: Evaluating Language-to-Code Generation Capabilities of Large Language Models

Saved in:

Bibliographic Details
Main Authors:	Ansong Ni, Pengcheng Yin, Yilun Zhao, Martin Riddell, Troy Feng, Rui Shen, Stephen Yin, Ye Liu, Semih Yavuz, Caiming Xiong, Shafiq Joty, Yingbo Zhou, Dragomir Radev, Arman Cohan
Format:	Article
Language:	English
Published:	The MIT Press 2024-10-01
Series:	Transactions of the Association for Computational Linguistics
Online Access:	http://dx.doi.org/10.1162/tacl_a_00705
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Bayesian Estimation of Generalized Log-Linear Poisson Item Response Models for Fluency Scores Using <tt>brms</tt> and <tt>Stan</tt>
by: Nils Myszkowski, et al.
Published: (2025-02-01)

Enhanced FFT–Root<tt>–</tt>MUSIC Algorithm Based on Signal Reconstruction via CEEMD<tt>–</tt>SVD for Joint Range and Velocity Estimation for FMCW Radar
by: Jiaxin Cao, et al.
Published: (2024-12-01)

<tt>PASTA</tt>: A Dataset for Modeling PArticipant STAtes in Narratives
by: Sayontan Ghosh, et al.
Published: (2023-11-01)

<tt>ssc-cdi</tt>: A Memory-Efficient, Multi-GPU Package for Ptychography with Extreme Data
by: Yuri Rossi Tonin, et al.
Published: (2024-11-01)

To B or not to be in single-trace TT¯ holography
by: Amit Giveon, et al.
Published: (2025-06-01)

Holographic action principle for TT¯-deformation
by: Amin Faraji Astaneh
Published: (2025-01-01)

<tt>TrialSieve</tt>: A Comprehensive Biomedical Information Extraction Framework for PICO, Meta-Analysis, and Drug Repurposing
by: David Kartchner, et al.
Published: (2025-05-01)

Introducing <tt>ActiveInference.jl</tt>: A Julia Library for Simulation and Parameter Estimation with Active Inference Models
by: Samuel William Nehrer, et al.
Published: (2025-01-01)

Subcarrier synchronization for satellite USB TT&C
by: Zhang Shiwei, et al.
Published: (2022-05-01)

Tetrahymena ATG8 homologs, TtATG8A and TtATG8B, are responsible for mitochondrial degradation induced by starvation
by: Shinya Matsuda, et al.
Published: (2025-06-01)

<tt>HJ-BIPLOT</tt>: A Theoretical and Empirical Systematic Review of Its 38 Years of History, Using Text Mining and LLMs
by: Roberto Cascante-Yarlequé, et al.
Published: (2025-06-01)

Core to Cosmic Edge: <tt>SIMBA-C</tt>’s New Take on Abundance Profiles in the Intragroup Medium at <i>z</i> = 0
by: Aviv Padawer-Blatt, et al.
Published: (2025-02-01)

Artificial Intelligence for Wireless Communications: The InSecTT Perspective
by: Ramiro Samano Robles, et al.
Published: (2025-01-01)

Sikos, T.T. and Molnár, D. (eds.): Budapest: Past and Future
by: András Kovács
Published: (2025-06-01)

FeTT: Class-Incremental Learning with Feature Transformation Tuning
by: Sunyuan Qiang, et al.
Published: (2025-03-01)

FAT or FiTT: Are Anvil Clouds or the Tropopause Temperature Invariant?
by: Jacob T. Seeley, et al.
Published: (2019-02-01)

On the Generalized $ \overline{\theta({\tt{t}})} $-Fibonacci sequences and its bifurcation analysis
by: Rajiniganth Pandurangan, et al.
Published: (2025-01-01)

µ−µ+ → νµνµttH amplitudes in the Feynman-diagram gauge
by: Zheng Ya-Juan
Published: (2024-01-01)

Key technologies of deep space TT＆C and telecommunication for Mars exploration
by: Wenfeng MA, et al.
Published: (2023-03-01)

Analysis of the Indicators Based on the DS/FH TT&C System
by: Youyou Xi, et al.
Published: (2013-02-01)

Simulation of the DD, TT and DT JET Neutron Streaming Experiments with TRIPOLI-4® Monte-Carlo code
by: Pontier Jean-Baptiste, et al.
Published: (2024-01-01)

Between the Teacher-Translator (TT) and the Officer-Translator (OT): The Useful but Elusive Handshake?
by: Tunde Ajiboye
Published: (2022-07-01)

Differential diagnosis of viral hepatitis (TT, Epstein-Barr) and systemic lupus erythematosus
by: O N Egorova, et al.
Published: (2007-10-01)

Obraz kapłana Chrystusowego w listach pasterskich (1-2 Tm, Tt)
by: Ewa Jezierska
Published: (2009-12-01)

VP_TT: A value propagation based equivalence checker for testability transformations
by: Ramanuj Chouksey, et al.
Published: (2021-02-01)

Numerical analysis of an incompressible soft material poromechanics model using $\tt {T}$-coercivity
by: Barré, Mathieu, et al.
Published: (2023-06-01)

Une machine à tenseurs TT sur les variétés d’Einstein
by: Delay, Erwann
Published: (2023-02-01)

A new quadrivalent meningococcal tetanus toxoid conjugate vaccine: Menquadfi® (MENACWY-TT)
by: Ener Cagri Dinleyici, et al.
Published: (2025-12-01)

Research the therapeutic, physicochemical, and pharmaceutical properties of the active compounds found in Tribulus terrestris (TT)
by: Roohallah Yousefi, et al.
Published: (2024-10-01)

Boundary quantum field theories perturbed by TT‾: Towards a form factor program
by: Olalla A. Castro-Alvaredo, et al.
Published: (2025-08-01)

Modelling car motion and the calculation of the wear of wheels with the VNITsTT rolling surface profile
by: A. M. Orlova, et al.
Published: (2019-05-01)

A method of vehicle/ship swing isolation for narrow beam TT&C equipment
by: Gu Baoguo, et al.
Published: (2024-01-01)

QUANTITATIVE ASSESSMENT OF RELATIVE HUMIDITY, K INDEX, AND TT INDEX USING PROGRAMMATIC ANALYSIS
by: Indrajit Ghosh, et al.
Published: (2025-06-01)

COT-TT vaccine attenuates cocaine-seeking and cocaine-conditioned place preference in rats
by: Susana Barbosa-Méndez, et al.
Published: (2024-12-01)

Exploration and Analysis of Resource Scheduling and Management Mode in Future Space TT＆C Network
by: Hong ZHANG, et al.
Published: (2023-12-01)

Immunogenicity of primary and booster MenACWY-TT vaccination in older adults and the importance of IgM
by: M. Visser, et al.
Published: (2025-06-01)

Tough talks COVID-19 (TT-C) digital health intervention: multistate randomized controlled trial
by: Henna Budhwani, et al.
Published: (2025-07-01)

Insights into TtCIPK gene family and its roles in durum wheat in response to PEG and ABA treatments
by: Hadiseh Sadat Hosseini Pouya, et al.
Published: (2025-07-01)

CoNfasTT: A Configurable, Scalable, and Fast Dual Mode Logic-Based NTT Design
by: Eldar Cohen, et al.
Published: (2024-01-01)

Resource Scheduling Method for Integration of TT＆C and Observation Based on Multi-Agent Deep Reinforcement Learning
by: Siyue CHENG, et al.
Published: (2023-03-01)