The test set for the TransCoder system
Ernest Davis
TL;DR
This paper discusses the limitations of the test set used for evaluating the TransCoder system, highlighting missing Java features like classes and user-defined functions, which affect the assessment of its translation accuracy.
Contribution
It identifies gaps in the existing test set for TransCoder, emphasizing the need for more comprehensive evaluation of Java features.
Findings
Existing test set lacks key Java features
TransCoder's accuracy on programs with classes is unknown
Evaluation of user-defined functions beyond recursion is incomplete
Abstract
The TransCoder system translates source code between Java, C++, and Python 3. The test set that was used to evaluate its quality is missing important features of Java, including the ability to define and use classes and the ability to call user-defined functions other than recursively. Therefore, the accuracy of TransCoder over programs with those features remains unknown.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsEvolutionary Algorithms and Applications · Embedded Systems Design Techniques · VLSI and Analog Circuit Testing