Garvit Juniwal, Alexandre Donze, Jeff C. Jensen, and Sanjit A. Seshia. CPSGrader: Synthesizing Temporal Logic Testers for Auto-Grading an Embedded Systems Laboratory. In Proceedings of the 14th International Conference on Embedded Software (EMSOFT), October 2014.

Download:

PDF

Abstract:

We consider the problem of designing an automatic grader for a laboratory in the area of cyber-physical systems. The goal of this laboratory is to program a robot for specified navigation tasks. Given a candidate student solution (control program for the robot), our grader first checks whether the robot performs the task correctly under a representative set of environment conditions. If it does not, the grader automatically generates feedback hinting at possible errors in the program. The auto-grader is based on a notion of constrained parameterized tests based on Signal Temporal Logic (STL) that capture symptoms pointing to success or causes of failure in traces obtained from a realistic simulator. We define and solve the problem of synthesizing constraints on a parameterized test such that it is consistent with a set of reference solutions with and without the desired symptom. The usefulness of our grader is demonstrated using a large data set obtained from an actual on-campus laboratory course.

BibTeX

@inproceedings{juniwal-emsoft14, author = {Garvit Juniwal and Alexandre Donz{\'{e}} and Jeff C. Jensen and Sanjit A. Seshia}, title = {CPSGrader: Synthesizing Temporal Logic Testers for Auto-Grading an Embedded Systems Laboratory}, booktitle = {Proceedings of the 14th International Conference on Embedded Software (EMSOFT)}, month = "October", year = {2014}, }