Research Update 6 ~Alex

By
Another good week! This week has been focused mostly on improving the plots for when they are included in my paper. They've been resized, reformatted, the titles fixed, colors changed, legend added and they are paper ready. In addition we have been investigating the best procedural steps to ensure optimal results. The NA cost debate from last week has been investigated further to include costs between 0 and 0.4 so we can decide definitively on a cost. Right now we have tentatively decided on 0.1 or 0.2 as that seems to be where the age cohorts disappear.



 In addition to NA cost we are looking to include normalization as a step, which will hopefully allow us to include larger sequences without any age cohorts. We are trying 4 different normalization procedures including maxlength shown below. The titles are the oldest age included in the  sequence. The colors are once again the ages.

Finally we have looked at internal clustering measures to determine the optimal number of clusters. We used ASW and PBC as before but this time we looked at age cutoffs and NA cost. Looking at these plots we determined 5 clusters is the optimal amount because that is right before a large drop off in the clustering performance.




Other than validating the new variables, which is not going so well, everything worked this week! We'll continue struggling with the variables next week, hopefully with better results!







2

Comments

Post a Comment

Popular posts from this blog

Week 10 Review: 9/6 - 9/10

By
Image
I spent all my time this week preparing for the end of the internship. I submitted a poster for admittance to the Association for Computing Machinery poster competition to be held at the Super Computing Conference in Dallas, Texas this year. Beyond that, I spent a lot of time organizing files and finishing mandatory assignments. On Monday I submitted a minute long video to a small competition for giving elevator pitches and got an honorable mention award on Thursday, which was a tie between 5th and 6th place out of 10. Not bad for one hour of recording at midnight. Thursday was the poster session for all the interns and it went fairly well. The expense of organizing the event probably wasn't worth the amount of visitors that came to participate, though. I will say that I was one of the few interns that presented their poster to Michael Stewart Witherell, the director of the lab! Now that was cool! The research poster presented at the final poster session There was a lot plan
Read more

Week 9 Review: 7/30 - 8/3

By
At the start of this week I tried to clean and analyze more recent Tstat logs from January and July of this year. To my surprise, these files were formatted differently from my previous files which meant I had to clean and compile them differently as well. This posed many unexpected problems that took much longer to solve than I first imagined. Also planned for the week was to add a way to identify the "normal" cluster to the algorithm and perform quantitative analysis on the similarities of the calculated sequences with the log(throughput). All at the same time, this content needed to be put into my poster for the intern poster session by noon on Friday. After cleaning, I tried to add the cluster identification step to the algorithm. I was running behind, so without finishing it I moved on to calculating quantitative similarity metrics. I didn't want to consider the similarity of the sequences when throughput is high (because our values turn out to be low) so I took the
Read more