Research update 7 ~Alex

By
This week has been very busy. The results section of my paper was due so the majority of my time was spent typing and editing and re-editing that. There were also some final decisions made about future steps. Instead of the NA cost strategy we've been following, we've decided to employ a delete strategy. In this strategy (which only works because there are only missing values at the end of the sequences) we will delete all missing values and be left with  sequences of different lengths. Then these mismatching sequences will be normalized and compared. This method gives faster and more accurate results than simply picking a substitution cost. Other than that change in beginning procedure, the rest of our methods have not changed. In addition to this decision, we have also decided on an ending age of 39 for our sequences.
The new variables are finally fixed and we have a final dataset. We are ready to receive our final clustering results and have ensured they will be accurate with extra cluster validity metrics, as graphed below.



The project is wrapping up! We should have conclusions and final results at the end of next week and a draft of both the paper and the poster submitted.
2

Comments

Post a Comment

Popular posts from this blog

Week 10 Review: 9/6 - 9/10

By
Image
I spent all my time this week preparing for the end of the internship. I submitted a poster for admittance to the Association for Computing Machinery poster competition to be held at the Super Computing Conference in Dallas, Texas this year. Beyond that, I spent a lot of time organizing files and finishing mandatory assignments. On Monday I submitted a minute long video to a small competition for giving elevator pitches and got an honorable mention award on Thursday, which was a tie between 5th and 6th place out of 10. Not bad for one hour of recording at midnight. Thursday was the poster session for all the interns and it went fairly well. The expense of organizing the event probably wasn't worth the amount of visitors that came to participate, though. I will say that I was one of the few interns that presented their poster to Michael Stewart Witherell, the director of the lab! Now that was cool! The research poster presented at the final poster session There was a lot plan
Read more

Week 8 Review: 7/23 - 7/27

By
Image
After week 7's setback, our research group had to restrategize our data analysis tactic. Instead of using the Degree of change metric with 4 clusters compared to log(Throughput), we chose a method using 2 clusters per window. In a very general sense, the performance of one data transfer could be considered "good" or "bad." We hypothesized that by using two clusters, one cluster would contain normal transfers, the "good" ones, and anomalous points, the "bad" ones. By considering the proportion of "good" points to all the points in one time window, we can make an approximation of what the throughput should be for the window, most notably, if the throughput is abnormally low. We didn't consider a way to identify the normal cluster from the anomalous because we weren't sure how well it would work in the first place. For the sake of time, we bypassed this hurdle by only considering the smaller of the two clusters. Our choice t
Read more