10_14_25
I'm just really living a full life now, and wanted everyone to know what that means, today.
1) I wanted to graph a custom line on an excel scatter plot.
2) I want to track down how the data miner we hired filled in missing data. IT WAS TOO COMPLICATED AND NOT WELL DOCUMENTED. Off to the interwebs. I've been using Weka lately. Weka is a collection of machine learning algorithms for data mining tasks. Weka contains tools for data pre-processing, classification, regression, clustering, association rules, and visualization.
Weka is a New Zealand bird with an inquisitive nature. I like the word inquisitive. It's like smooooooooth curiosity.
3) Figuring out which filling in missing values method I want to use myself. As always, test on performance. Was going down this route till my boss pointed out he just wanted to see if it looked like the method had just as good results on a different data set than the one I used. Aka get to the result faster, don't worry about filling in missing data, just remove those examples and work with the reduced data set.
PRINCIPLES LEARNED or REITERATED
1) Pareto: Roughly 80% of the effects come from 20% of the causes
- I added a new column on my raw data sheet and for every x value computed the y using my regression equation. Then, I graphed the points and chose the "Show trend line" option. It's not perfect since I'd rather it just show the line and not the made up points underneath, but it works.
Weka is a New Zealand bird with an inquisitive nature. I like the word inquisitive. It's like smooooooooth curiosity.
3) Figuring out which filling in missing values method I want to use myself. As always, test on performance. Was going down this route till my boss pointed out he just wanted to see if it looked like the method had just as good results on a different data set than the one I used. Aka get to the result faster, don't worry about filling in missing data, just remove those examples and work with the reduced data set.
- "80% of your sales come from 20% of your clients"
- "80% of the land in Italy was owned by 20% of the population"
Comments
Post a Comment