Previous goals

Take a break after the ICSE submission!

Previous goals

• Review and merge the new pipeline.
• Run the new pipeline on the new Flexeme decomposition and SmartCommit decomposition
• Update RQ2 analysis to remove the performance biais generated the tools
• Open issues for remaining work on the paper. The todo list is in my personal notes at the moment.
• Work on the paper

  Progress

  This week I mainly work on the paper and one extra last experiment, which is running Flexeme on the synthetic benchmark. We have 2 days!

• I merged in the clean-java implementation (finally) which worked on all files. I also investigated the perplexing issues of why SmartCommit failed on a nontrivial number of bugs before but succeeded on all bugs now - turns out, it is a very specific issue which the checked out Defects4J bug repository, which caused git diff command between the buggy SHA hash and the fixed SHA hash to error.
• Generated a synthetic benchmark on Defects4J using Flexeme’s heuristics and obtained results for Flexeme synthetic benchmark. It’s too ambitious to actually implement research question 3, and with Thomas’ advice I decided to put a hold on trying to run SmartCommit on the synthetic benchmark.
• As Thomas updated RQ2 to work with the new metrics and investigated the effect of the tool performance on the metrics, we met to discuss the paper writing directions and only worked on polishing the papers/results on the day of the submission.
• Addressed feedback, worked on TODOs, ran extra experiments and analyses as required by the paper.

  Next goals

  Take a break for the rest of the week!

Previous Goals:

• Automate analysis script for table 3 in auto-analysis
• Set up end to end tests on new-pipeline and respond to Thomas’ concerns
• Generate all results on Defects4J, generate tables/figures, rewrite the analyses
• Work on the paper

Previous Goals:

• Create a Docker Image on Linux to finally set up end to end testing on Github Actions
• Top priority: run new diff metrics program and ground truth construction on all compatible bug files. The paper needs results now!
• Resolved end to end testing issue: Java being non-deterministic for SmartCommit
• I will be volunteering at ISSTA, so I expect to be taken away from research for some time :)

Previous Goals:

• Integrate Mike’s implementation into the pipeline
• Get Mike’s and Thomas’ code review on unix-patch branch
• Read paper of replicating running the tools on synthetic commits & Paper on new tangled dataset
• Run experiments and complete TODOs as requested by Thomas and Mike.

Previous Goals:

• Get Thomas’ opinion and review on the implementation for tangle hunk and line support in the ground truth.
• Look for ways to convert Flexeme and SmartCommit results to diff formats.
• Read paper of replicating running the tools on synthetic commits & Paper on new tangled dataset
• Run experiments and complete TODOs as requested by Thomas and Mike.

Week 4 Progress Report

Previous Goals:

• Resolve how to handle Flexeme’s inconsistent clustering results for end-to-end tests
• Write a draft of .yml file to install tools on MacOS for github workflows
• Get the regression test running in continuous integration on Github Actions
• Refactoring: Identify parts of the pipeline where unix diff can be used instead of CSV and implement if possible
• Implement tangled lines/hunks: add new functionality

Previous Goals:

• Merge all pull requests and resolve the remaining documentation issue on untangling_score.py
• Put the two diagrams (for ground truth and evaluation pipeline) into the repository
• Create an end-to-end test of the 5 repositories, for use as a regression test
• Get the regression test running in continuous integration

The goal of this week is to pick a research topic that is interesting to me and derive a summer plan. Mike and I decided that I will join Thomas’ Untangling Tools project (advised by Mike and René), and I’m very excited!