Showing posts with label data. Show all posts
Showing posts with label data. Show all posts

Sunday, March 01, 2015

Frank Kaminsky - College Basketball Player of the Year

Frank Kaminsky is in what is widely seen as a two way race for College Basketball Player of the Year.

Response to: Is Okafor or Kaminsky leading the Player of the Year race right now?

I don't remember many people caring about defense when Kevin Durant and Doug McDermott won their National Player of the Year awards, and freaking James Harden is maybe about to win MVP of the NBA. So let's stop trying to redefine things now.
I think the reason people point out Okafor's defensive weakness in POY discussions is because there are 2 players that are very close offensively but one is much better defensively. That becomes an important point. It isn't that defense never matters for POY or MVP it just usually isn't so relevant.

Kevin Durant and Doug McDermott outclassed everyone else so if they were not great on defense it didn't matter they still were by far the best players.

Okafor is very good. It seems to me Kaminsky is the leading candidate by a large margin, due to his defensive prowess and offensive versatility. The issue is debatable but it doesn't seem close to me. Even if they were defensively equal it seems to me Kaminsky is deserving, though then it becomes more debatable, how valuable is a dominate post player compared to a dominate post player that also is a three point threat and great passer and ball handler. But add it the defensive part of the game and it widens the gap between them quite a bit.

Not being able to shoot free throws also matters. Okafor is still a great player but when he shoots 54% on free throws that is another strike against him (Kaminsky is making 75% - Kaminsky can be used in late game situations to handle the ball even if he will be fouled). It doesn't mean he isn't great but when another candidate for player of the year is so close in many ways but has several significant additional strengths these add up to make a big difference in finding the absolute best player of the year.

I am a Wisconsin fan so it could be my bias, I understand, but when you watch him play over the long term you appreciate how good Frank Kaminsky is all game long, every game.

Related: Universities Again Abandon Fans/Mission to Increase Pay to Administrative Staff/Coaches - Systems Thinking: The Later You Are Picked The Better Off You Are - Davidson Students Get Free Sweet Sixteen Trip

Saturday, November 10, 2012

Page Rank Updates for November 2012

The pagerank google displays is mainly a fun measure, rather than a measure of much importance. But I still find it fun to look at the pagerank values - except when they go down for my sites :-(  Now I also track the similar MozRank and can take some solace if the MozRank goes up :-)

Pagerank is a value given to the links coming into a web page on a logarithmic scale. So a PR of 2 is 10 times greater than PR 1 and 100 less than PR 4. MozRank is a similar measure, developed by a separate company that is updated much more frequently. See more details on this topic in my previous post: Google PageRank and MozRank of some of my pages (Oct 2011).

Google updates the visible PageRank occasionally (often about every 3 months). The real pagerank Google updates much more frequently (it is only the pagerank shared with the rest of us that is only updated occasionally.

Check the current pagerank on your sites using our related site: Multiple Site PageRank checker.

SiteNov 2012
[MozRank]
Oct 2011April 2011Dec 2010Dec 2008July 2008
PageRank 5 and MozRank > 5
Curious Cat Management Blog5 [5.6]
Curious Cat Engineering and Science Blog5 [5.6]6 [5.3]6455
John Hunter5 [5.5]4 [5.4]4444
CSS 4 Free5 [5.5]4 [5.4]4445
Management Dictionary*5 [5.2]5 [5.4]5433
Public Sector Continuous Improvement Site*5 [4.8]5 [5.0]54
PageRank 4 and MozRank > 5
Curiouscat.com4 [5.6]4 [5.6]5433
Curious Cat Management Improvement Connections*4 [5.4]5 [5.5]5433
Curious Cat Investing and Economics Blog4 [5.4]4 [5.3]4344
Investment Dictionary*4 [5.3]4 [5.2]4
externs.com - internship directory4 [5.2]4 [5.2]4444
Management and Leadership Quotes4 [5.1]2 [5.2]22
Alumni Connections*4 [5.1]4 [5.0]4445
Curious Cat Travel Photo Blog4 [5.0]3 [4.9]3-
Credit Card Tips*4 [5.0]4 [4.6]3
Lean Management Resources*4 [5.0]4 [5.0]44
Curious Cat Code (programming)4 [5.0]4 [4.2]00
Curious Cat Gadgets4 [5.0]--
PageRank > 4 and MozRank < 5
Six Sigma Management Resources*4 [4.9]4 [5.0]4
Economic Strength Through Technology Leadership*4 [4.9]4 [4.7]544
Living in Malaysia4 [4.9]3 [4.1]-
Statistics for Experimenters4 [4.8]3 [4.5]3434
The Future is Engineering*4 [4.8]4 [4.7]
Living in Singapore4 [4.8]3 [4.0]-
55
PDSA Improvement Cycle*4 [4.7]4 [4.9]4
Curious Cat Web Directory4 [4.7]4 [4.7]**334
Architecture and home design inspiration4 [4.7]--
Life and Legacy of William Hunter (my father)4 [4.6]4 [4.5]444
Management Matter (my book)*4 [4.6]-----
Multi Site PageRank Checker4 [4.6]3 [4.7]2213
Mortgage Rate Article*4 [4.5]4 [3.8]4
Management Articles*4 [4.4]
PageRank 3 and MozRank > 3
The Engineer That Made Your Cat a Photographer*3 [4.9]4 [4.7]543
Hexawise Software Testing Blog3 [4.9]----
Curious Cat Travel Destinations3 [4.8]-----
Rocky Mountain National Park photos*3 [4.8]4 [4.8]4 3-2
Deming's Management Method*3 [4.6]4 [4.5]44
Best Research University Rankings*3 [4.4]3 [3.8]334
Curious Cat Management Comments3 [4.1]
Curious Cat Comments (this blog)3 [4.1]- [3.8]-33
Management Improvement Resources3 [4.0]3 [3.8]333
The W. Edwards Deming Institute Blog3 [3.8]-----
Good Process Improvement Practices*3 [3.8]3 [4.1]
PageRank 2 and MozRank > 2 (or no MozRank for new pages)
Johor Bahru Real Estate2 [4.7]--
Curious Cat Travel Destinations: Marina Bay Sands (Singapore)2 [4.5]-----
Justin Hunter (my brother)2 [4.0]2 [2.9]222
Parfrey's Glen, Wisconsin Photos2 [3.7]2 [3.8]22-
CuriousCat Wordpress2 [3.1]-----
No PageRank
My Kiva pageu [4.0]- [4.0]-3
Hexawise.tv------
Curious Cat Travel Destinations: Australiau [3.6]-----
Curious Cat Travel Destinations: Franceu [3.6]-----


* internal pages
** new url, old url forwarded
- didn't exist yet
u unranked
[blank] I don't know what the pagerank was, sometimes the site didn't exist yet.

Related: PageRank Updates for August 2012 - Web Page Authority - Google's Search Results - Should Factors Other Than User Value be Used

Tuesday, September 25, 2012

Fruitful melding of advanced theory and technology

I like this sentence, and think it is conveys meaning.  From  Google Spanner's Most Surprising Revelation: NoSQL Is Out And NewSQL Is In

Only Google solved the problems in a typically Googlish way, through the fruitful melding of advanced theory and technology.
That statement does a good job of capturing Google's strength and weakness.  I think Google is not very good at solutions that are not the combination of those two items (with a bit of an engineering mindset focused on maximum economic benefit thrown in).  It seems to me Google wants an "unbiased" measure of performance and uses profit in that way (this is my view as an outsider).

Google has continued to struggle greatly with customer focus, as I see it.  It might be we need to get much better academic research on the value of customer care before Google will be able to adopt strategies consistent with valuing customer service - more than the throw away way they general do now.

Research fits Google's theory and technology focus.  Once it can be arguably be measured in the marketplace I think Google gets uncomfortable.  They plug away, but it seems like they are out of their natural element in this situation - until it is easy to find market measures of value.  Some things immediately go from research to production.  Some things have to be developed quite a bit - I think Google gets uncomfortable in this space, they want to hurry up and let the market tell them: and not have to rely on judgement of people doing the work.

Google's appreciation for theory is shared by leading thinkers at the most innovative organization of the last 100 years (Bell Labs etc.) but in most organizations MBA's hold sway and MBA's (in general) don't have a clue about the value of theory.  

I think the MBA's failure to understand the value of theory is largely is due to the failure of basic scientific literacy in our society.  Which then leads to people confusing theory in a scientific context and theory in a I have this odd ball idea I thought up in the shower last night that I call a "theory."  Disrespecting the 2nd kind of theory is fine.  When you can't understand the difference between a well supported theory and ignorant pontification that is a big problem.


Related: Richard Feynman Explains the PDSA Cycle - The Illusion of Knowledge - Bogus Theories, Bad for Business

Friday, July 13, 2012

If You Create a System That Includes The Perfect Conditions for Scandals, Expect Scandals to Happen

Massively overpay people for taking huge gambles with other people's money and they will do so (ethical people won't, but you only need a few unethical people and their is an oversupply - county on running out of unethical people is an extremely foolish "strategy").   Make it even worse by creating a culture where everyone sees lots of people getting massively overpaid for the times when the roulette wheel lands in the right spot and you create a culture ripe for claiming good results (no matter what the truth is).  Add in a very smart strategy (for those seeking to siphon off billions from the productive economy) of creating massively complicated schemes that allow for all sorts of false claims and you have what the leaders of our country (and a few other countries leaders) have created.

Other leaders abolished child labor, created universal education, sent us to the moon.  Ours are busy justifying massively unjust payments to a few at the cost of the well being of the country and the citizens of the world.

The too big to fail welfare banks have been practicing this behavior for a couple of decades.  And, like clockwork, huge scandals occur.  It seems like we have a huge spike in scandals in the last couple of years.  The scandals are entirely predictable given the systems created to try and justify paying unjustifiable payments to executives and gamblers.

The reason for the spike in scandals being discovered now is probably 2 fold.  First the unjustified pay has increased massively and thus increased the irresponsible behavior and rewards for being irresponsible.  Also, fraud often remains hidden in boom times and becomes uncovered when the ability to hide that the roulette wheel hasn't actually been providing the returns used to claim the unjustifiable payments taken by the executives and gamblers.

The quote of the latest massively overpaid CEO overseeing yet another scandal is just the same as all the other mindless "explanations": 

'But he stressed that it was an “isolated” incident and that JPMorgan had already cleaned house'

They then pay those we elect enough to have those we elect continue to grant them massive favors and continue to allow the undermining of our economy by the continued scandalous practices.  The process will continue, as it has for decades, until we refuse to elect those that sell out the country to pay back those giving the politicians lots of cash (or for the politicians that can't understand what is happening).

Eventually the delaying game of those operating these phony systems to extract big payoffs for themselves will no longer be tolerated.  But so far we seem happy to continue to support leaders doing all they can to support this system.

It doesn't appear, even now, we are going to demand change.  And it is completely obvious the too big to fail welfare banks are just increasing the scandalous behavior and the politicians are just increasing their support for these institutions.  Oh the politicians will say silly things to claim they don't like the bad things being done to the country and then run right back and do the bidding of those at the too big to fail welfare banks that give them cash.  Those giving cash know it doesn't matter what politicians say only what they do.  And the too big too fail banks couldn't ask for any better lackeys.

It will change when we throw out the politicians that are (and have been for decades) making this possible.  Until we do it won't change.  The executives and politicians have shown no amount of suffering is enough for them to behaving honorably.  As long as they get their cash they don't care what it does to the country or the economy of the world.

Wednesday, May 16, 2012

Using Twitter Data to Improve Search Results


Doesn't it seem pretty obvious that it would be possible to use Twitter mentions to improve search results?

I understand you would have to deal with people trying to "game the system."  Google seems pretty good at doing this.

The nofollow attribute was suggested by Google as a way of marking untrusted links.  I don't believe the application of that is great, but that was Google's plan.  One weakness is the nofollow name is not the same message as untrusted link.  This might not have mattered to Google originally but when you add confusion unnecessarily you open the door to problems.

Google then added to the problems by declaring paid for links should also be nofollow.  Again Google confusing the issue - if they want paid links noted as paid it is fine for them to say that is what they would like.  And if they want to treat paid links the same as untrusted links that is their option.  I think it is a mistake but it is their option.  Telling people they are suppose to mark links as nofollow when they are paid seems confused and lame to me.

Lately I have heard sources quote Google as saying we can't follow Twitter links because they told us not to.  And those are saying that using the untrusted link text Google asked them to was how Twitter told Google not to follow the links.

So anyway here we are today and there are many ways for a search engine to decide some Twitter accounts are trustworthy and that links from those accounts are an indication of the merit of the site linked to.  Why would you not use this information?  Even if Twitter told you the links were untrustworthy (because they were worried about sanctions Google might impose if they linked to sites Google didn't like without making those links nofollow) that doesn't mean you couldn't use the data from Twitter links to improve results.

Maybe in the decision to use the term nofollow and then set standards for what Google would do around this link Google has put themselves in a position where they can't follow nofollow links and do what they said they would do.  I am not sure about this.  But if they can't take advantage of useful data to make search results better due to their previous mistake of calling a untrusted link nofollow they should correct that failure.

If sites want to tell Google not to follow links that is fine (to preserve server bandwidth or just because they don't like Google or whatever).  But, I believe, most nofollow links are now used to

   1) avoid sanctions by Google
   2) keep "link juice" for the monetary benefit of the site that makes the link nofollow (ironically, that makes the non-nofollow links "follow" links essentially for monetary gain, which somewhat subverts Google's desire to remove monetary incentive from placing links)

It seems foolish to me to not use information that could make search results better.  It seems to me valuable information to make search results better is now clouded by nofollow links.  I certainly would be using that information if it were up to me.  And my guess is you can use a large part of it even if the past decisions mean you can't follow the links (this likely would make the silly use of link shorteners more of an issue - but at least the urls that are actually shown could be used to improve search results).

I am pretty sure Google ignores useful measures hidden in nofollow data.  I woudl guess the other search sites are ignoring it too, but I am not sure.

Related: Viewing Unpersonalized Google Search Results - Google Rank Patent for Delegation Authority Factors

Monday, October 03, 2011

Google PageRank and MozRank of Some of My Sites

Pagerank is a value given to the links coming into a web page on a logarithmic scale. So a PR of 2 is 10 times greater than PR 1 and 100 less than PR 4. MozRank has been round a couple of years now and seems to be a decent addition to looking at PageRank. It is updated much more frequently and for some reason is using a scale of 8 instead of 10***, so a PR of 2 is 8 times greater than PR 1 and 100 less than PR 4. MozRank also shows the result to 2 decimal places, which is nice. A PageRank value of 5 could range all the way from 4.5 to 5.49 - those values are almost 100 times different in their magnitude. In the chart below I round MozRank to the nearest tenth of a point.

Now the visible PageRank is just a way of Google letting other people see the relative PageRanks of web pages. The real pagerank Google updates much more frequently. The real pagerank is what is used as a factor in search results. I also believe Google now includes penalties to visible pageranks that are not actually used in their search rankings. So they can show a visible indication that the site is not as highly ranked as it may be (this is most easily noticeable when pages have a reduction in pagerank with no real world explanation).

PageRank matter but is hardly a huge factor. It is much more important to have links from related pages than just high pagerank pages, for being ranked highly in Google search results. And the link text used in links to your pages is very important for how well you rank in search engines. However a link from a page with a PR of 7 would be much better than and a very similar page with a PR of 1. Pagerank "passed" to the linked to page is divided by the total number of links on the page. So if you had a link from a relavent PR 7 page with 10 links that would provide 5 times more "pagerank" than the same PR 7 with 50 links.

In my last post I said "Another thing I have noticed much more over the last few years is having PR for internal pages is much harder." What I have noticed in the last few months is many more internal pages seem to have decent page ranks (very high, above 4, is still fairly rare): lots more internal pages show ranks of 1,2,3 and 4 than I noticed in the last few years You might get the wrong impression from the table below as I picked out the somewhat rare internal pages with decent page ranks to track.

The displayed pagerank is mainly a fun measure, rather than a measure that can be relied on as an important measure. But I still find it fun to look at the pagerank values - except when they go down for my sites :-( Now you can take some solace if your MozRank goes up :-)

For those wondering if I take special Search Engine Optimization (SEO) actions to achieve these results, I don't really. I try to create good content and provide value to users. That is what I did long before I ever heard of SEO. I do include links to my other sites when I think it is worthwhile. My sites are almost all created out of my personal interests (or maybe all, to varying levels, a couple of sites are things that kind of interest me but are maybe more experiments then core interests to me). It isn't surprising they link together in various ways. Again long before I heard of SEO (and the term was even used) I wrote others with web sites on similar topics to share what I offered.

With the advent of blogs, I commented on blogs I read. I do make some effort to try and have sensible urls from an SEO perspective. And I make an additional effort to comment on blogs in order to "market" and SEO reasons. But I do so not by spaming blogs but with thoughtful comments. Those thoughts may be lame, but they are mine, based on the topic and meant to add to the conversation. I doubt I average more than 10 comments a week on blogs. It really is more about adding to the conversation than getting links that some computer reads. Also a few (very few) people reading the thoughtful comments will follow the link to my site and subscribe to RSS feeds, add links to my posts... I occasionally suggest links to blog carnival - probably less than 10 times a year. That is about it.

Check the current pagerank on your sites using our related site: Multiple Site PageRank checker.

SiteOct 2011
[MozRank]
April 2011Dec 2010Dec 2008July 2008
PageRank 6
Curious Cat Engineering and Science Blog6 [5.3]6455
PageRank 5 and MozRank > 5
Curious Cat Management Improvement Connections*5 [5.5]5433
Management Dictionary*5 [5.4]5433
PageRank 5 and MozRank < 5
Public Sector Continuous Improvement Site*5 [4.97]54
PageRank 4 and MozRank > 5
Curiouscat.com4 [5.6]5433
CSS 4 Free4 [5.4]4445
Curious Cat Investing and Economics Blog4 [5.3]4344
externs.com - internship directory4 [5.2]4444
John Hunter4 [5.4]4444
Investment Dictionary*4 [5.2]4
Lean Management Resources*4 [5.0]44
Six Sigma Management Resources*4 [5.0]4
Alumni Connections*4 [5.0]4445
PageRank 4 and MozRank > 4
PDSA Improvement Cycle*4 [4.9]4
Rocky Mountain National Park photos*4 [4.8]43-2
The Engineer That Made Your Cat a Photographer*4 [4.7]543
Economic Strength Through Technology Leadership*4 [4.7]544
The Future is Engineering*4 [4.7]55
Curious Cat Web Directory4 [4.7]**334
Credit Card Tips4 [4.6]3
Deming's Management Method*4 [4.5]44
Life and Legacy of William Hunter (my father)4 [4.5]444
Curious Cat Code (programming)4 [4.2]00
PageRank 4 and MozRank < 4
Mortgage Rate Article*4 [3.8]4
Reddit management*4 [u]740
PageRank 3 and MozRank > 3
Curious Cat Travel Photo Blog3 [4.9]3-
Multi Site PageRank Checker3 [4.7]2213
Wordpress Themes for Free3 [4.7]333
Statistics for Experimenters3 [4.5]3434
Living in Malaysia3 [4.1]-
Living in Singapore3 [4.0]-
Management Improvement Resources3 [3.8]333
Best Research University Rankings*3 [3.8]334
Good Process Improvement Practices*3 [3.8]
PageRank 2 and MozRank > 3
Management and Leadership Quotes2 [5.2]22
Sea World - Australia2 [4.5]22
Wet-n-Wild - Australia2 [4.2]22
Parfrey's Glen, Wisconsin Photos2 [3.8]22-
PageRank 2 and MozRank > 2
Justin Hunter (my brother)2 [2.9]222
No PageRank
My Kiva page- [4.0]-3
Curious Cat Comments (this blog)- [3.8]-33
Johor Bahru Real Estate (brand new site)--


* internal pages
** new url as of January 2011, old url forwarded, by Oct 2011 report the pagerank updated
- unranked
[blank] I don't know what the pagerank was, sometimes the site didn't exist yet.
*** Google doesn't say they use a scale of 10 for the logarithmic PageRank. It seems as good a guess and any and is easier to picture so I use that until we have some new evidence.
Related: Web Page Authority - 6 years Later Goolge Acts To Let Me Block Sites I don't want to see - PageRank Distribution - Google's Search Results - Should Factors Other Than User Value be Used

Thursday, September 29, 2011

Google Analytics is Now Real Time

Google analytics is a great easy to use tool to track the use of your web site. One missing feature was real time data. When I was getting indications of increases in traffic it was sometimes hard to pin down what was going on. Today Google added real time support. This will be greatly appreciated when I want to obsess over some web details in real time. Whats happening on your site right now
You’ll find the Real-Time reports only in the new version of Google Analytics. If you’re not already using the new version, you can start by clicking the “New Version” link in the top right of Google Analytics. Real-Time reports are in the Dashboards tab (though they will move to the Home tab in the updated interface next week) . You will have access to Real-Time reports if you are an Administrator on your Analytics account, or if you have access to a profile without profile filters. Real-Time does not support profile filters. We just turned the reports on for a number of you, and over the coming weeks, everyone will have access to Real-Time. If you can’t wait, sign up for early access here: https://services.google.com/fb/forms/realtimeanalytics/. We’d love to hear about how you are using (or planning to use) Real-Time, so please share in the comments.
Unfortunately the new interface has a horrible navigation scheme if you have lots of sites. It is just horrible. It prevented me from using the new site until now. I doubt I can put up with it for long. Related: Looking at the Google PageRank of Some of My Sites - 6 years Later Goolge Acts To Let Me Block Sites I don't want to see - Search Share Data, Checking the ACSI

Saturday, April 23, 2011

Current Look at Google PageRank of My Sites

Google used to push major visible PageRank updates about quarterly and do very little, if any, pagerank changes at other times. Pagerank is a value given to the links coming into a web page on a logarithmic scale. So a PR of 2 is 10 times greater than 1 and 100 less than PR 4. It is named for Google co-founder and current CEO Larry Page. Google doesn't do the quarterly updates anymore (they have been less frequent) and seems to make many more adjustments to PageRanks all the time.

Now the visible PageRank is just a way of Google letting other people see the relative PageRanks of web pages. The real pagerank Google updates much more frequently. The real pagerank is what is used as a factor in search results. I also believe Google now includes penalties to visible pageranks that are not actually used in their search rankings. So they can show a visible indication that the site is not as highly ranked as it may be (this is most easily noticeable when pages have a reduction in pagerank with no real world explanation).

PageRank matter but is hardly a huge factor. It is much more important to have links from related pages than just high pagerank pages, for being ranked highly in Google search results. However a link from a page with a PR of 7 would be much better than and a very similar page with a PR of 1. Pagerank "passed" to the linked to page is divided by the total number of links on the page. So if you had a link from a relavent PR 7 page with 10 links that would provide 5 times more "pagerank" than the same PR 7 with 50 links.

Another thing I have noticed much more over the last few years is having PR for internal pages is much harder. Many sites with PR of 3 or even 4 on the homepage may have no other pages with PR. It seems to me, that this is true far more than the math would indicate, so my guess is Google is reducing PR internal often in some way I have no idea about. Again remember the displayed PR google provides doesn't have to correspond to the real one they calculate and use.

The displayed pagerank is more fun than a measure that can be relied on as an important measure. But I still find it fun to look at the pagerank values - except when they go down for my sites :-(

Check the current pagerank on your sites using our related site: Multiple Site PageRank checker.

SiteApril 2011Dec 2010Dec 2008July 2008
Curious Cat Engineering and Science Blog6455
Curious Cat Management Improvement Connections*5433
Curiouscat.com5433
Management Dictionary*5433
Public Sector Continuous Improvement Site*54
The Engineer That Made Your Cat a Photographer*543
Economic Strength Through Technology Leadership*544
The Future is Engineering*55
Curious Cat Investing and Economics Blog4344
Deming's Management Method*44
CSS 4 Free4445
Life and Legacy of William Hunter (my father)444
externs.com - internship directory4444
John Hunter4444
Investment Dictionary*4
Lean Management Resources*44
Mortgage Rate Article*4
Six Sigma Management Resources*4
Rocky Mountain National Park photos*43-2
Alumni Connections*4445
PDSA Improvement Cycle*4
Curious Cat Travel Photo Blog3-
Living in Malaysia-
Statistics for Experimenters3434
Management Improvement Resources333
Credit Card Tips3
Management and Leadership Quotes22
Wordpress Themes for Free333
Multi Site PageRank Checker2213
Justin Hunter (my brother)222
Curious Cat Web Directory**334
Best Research University Rankings*334
Parfrey's Glen, Wisconsin Photos22-
Sea World - Australia22
Living in Singapore-
Reddit management*740
Curious Cat Code (programming)00
My Kiva page-3
Curious Cat Articles and Links (this blog)-33


* internal pages
** new url as of January 2011
- unranked
[blank] I don't know what the pagerank was, sometimes the site didn't exist yet.

In my experience it is often more telling how the pagerank of internal pages. The sites that have high ranking internal pages are much rarer than site with say a pagerank of 4 or even 5 on the home page.

Also note that a PR of 4 could be nearly 10 times higher than another PR 4. For example if 3.5 is shown as 4 (Google only shows an integer) and 4.4 is shown as 4 given the logarithmic scale used the 4.4 would be 9 times greater than the 3.5. PageRanks are logarithmic and then compared to the other pages on the web. So if a site was very close to 3.5 it might show up as 3 one time then 4 then 3 again... all without any significant change. On the other hand going from the absolute lowest 3 to the absolute highest 4 could be nearly a 100 times increase.

Related: Last Google Toolbar PageRank Update of 2008 - Web Page Authority - 6 years Later Goolge Acts To Let Me Block Sites I don't want to see - PageRank Distribution - Google's Search Results - Should Factors Other Than User Value be Used

Tuesday, March 15, 2011

Productivity Growth and Government Debt

Who reaps the rewards of productivity?

Productivity matters for the prosperity of children because it measures the amount that an average worker produces in an hour of work. If productivity rises by 10% over three years, that means that we can produce 10% more output with the same amount of work than we could three years ago. The size of the economy was roughly $14tn three years. A 10% rise in productivity means that we can produce approximately $1.4tn more this year with the same amount of work. This would come to an additional $18,000 a year for an average family of four.

Alternatively, a 10% rise in productivity would mean that we could produce the same amount of output as we did three years ago, while working 10% less time.
...
At this point, the politicians start screaming about the debt bankrupting our kids. The problem with this claim is that our kids will own the debt. At some point, all of us will be dead, meaning that the people who hold the bonds that constitute the debt will be our children and grandchildren.

How can holding government bonds make our children bankrupt?


The author dismisses the problem of foreign ownership of government debt erroneously. The problem is if you have to pay foreigners the interest that is essentially a tax on current production to pay for past overspending.

Japan has far more government debt than other countries. http://investing.curiouscatblog.net/2010/10/18/government-debt-as-percentage-of-gdp-1990-2009-usa-japan-germany-china%E2%80%A6/ Yet that is not as big a problem as it seems as they owe most of it to themselves. That is still not a great condition to be in but it means you will just have to pay a portion of yearly production to pay off a segment of society that owns that debt (it stays within your country).

Now all of this gets much more messy nowadays as the borders are much more transparent and movement is much easier...

I agree that productivity improvements are great and will help with the problem. But you have to understand that productivity measurements are extremely unreliable. All economic data has issues (see all the consternation over unemployment and inflation data) but productivity measures may well be the most problematic. They rely on significant guesses about what is really going on and have issues with short term unsustainable 'gains' often due to layoff, cutting maintenance... (things that get better productivity numbers but may well just be measurement issues not sustainable productivity improvements).

The author does correctly point out the problem of foreign ownership of debt is due to us living beyond our means (not in those words though) and borrowing from foreigners to sustain this level of comfort (just like the government is doing itself).

Related: The USA Economy Needs to Reduce Personal and Government Debt - Government Debt, Greece is a Very Small Part of the Problem - Dollar Decline Due to Government Debt or Total Debt? - Economic Measurement Issues Arising from Globalization

Wednesday, January 05, 2011

Unemployment - hidden activity?

I Wonder How Many Unemployed Folks Are Hustling

But the idea here is that "hustling" is any kind of economic activity that you are not reporting to the government; either because you don't want to go to jail or just don't want to pay taxes or for them to know how much you make.
...
Are my hypothetical self and this real life person the majority of the unemployed? Of course not. But you've got to at least wonder how many of them are out there.


Probably the most important part of that measure would be a measure of the change in that during the employment cycle. If it were say 2% of the population every year while the IRS might want to know it isn't a huge factor in thinking about the state of the economy and employment. If it is 8% of the population today, and was 2% 5 years ago, that would be more interesting and let you know the situation may not be as bad as you think (looking just at employment data). I personally doubt it is a significant macro-economic factor (the variation in it during the employment cycle).

Looking at this rate between countries would probably provide valuable information. Some of the Euro and bank scandals have shown the underpaying of taxes by Europeans and also the rich Americans suing to prevent disclosure of their fraudulent tax avoidance aided by large bailed out banks.

Related: How do I Know What Unemployment Statistics Mean? - Another 663,000 Jobs Lost in March, 2009 in the USA - Can Bankers Avoid Taking Responsibility Again?

Saturday, August 07, 2010

Suicides: Foxconn, Cornell and the Golden Gate Bridge

Wrong on So Many Levels

Foxconn Installs Antijumping Nets at Hebei Plants. Anti-jumping nets?

Having built safety nets along its employee dormitories after a series of jumping suicides at its Shenzhen production plant, Taiwanese electronics manufacturing giant Hon Hai Precision Industry Co., which uses the trade name Foxconn, is now installing the same sort of nets at some of its inland factories

...
If things are so bad that people would rather hurl themselves off of tall buildings than work in a Foxconn factory (or even just go find a factory job down the street) it seems like Foxconn should put the nets on the doors of their factories to catch people from going in.
...
The 42,000 employees in the Shenzhen plant assemble nearly 70% of the iPhones and iPads for Apple. There have been 10 factory workers who jumped to their deaths in the first 5 months of 2010 at the Shenzhen plant



It is wrong on many levels. I do think Apple has some responsibility. I do think human psychology around suicide is complex and confusing and cause and affect can be confused by correlation not cause.

Putting the nets there sure looks lame, and like non-root cause problems solving. But if they actually save lives then what? There are nets below the Golden Gate bridge (also to reduce suicide deaths) after quite a bit of debate. It sure takes a long time for them to act. 2 years later and still barely moving forward.

Cornell University has a long term problem with suicide jumpers, 6 this year - and they have installed suicide prevention fences:

Several suicides clustered in a close proximity of time and location, such as what Cornell experienced in late winter, are known to cause an "imitation" effect on vulnerable members of the community, elevating their risk of suicide. No one knows for sure how long the elevated risk can last, but the mental health professionals Cornell consulted said that it is very likely to continue for the foreseeable future and strongly recommended that temporary barriers remain in place while permanent means restriction measures are explored and designed.


I am not at all sure the suicide prevention nets at Foxconn are a bad idea. They certainly "look" (visually, and the image they convey is not being very root cause problem solving like) bad.

If we examine Cornell and Foxconn together what answers might we find? I think there are things to fix at Foxconn, but it is very easy for those of us the USA to just paint management as villainous. I don't think we will paint Cornell professors as villainous. Foxconn absolutely needs to do much more than put up nets. But whether putting up nets is good short term fix (like Cornell's) I think is at least debatable.

Problem solving can be quite complex. Especially with something like suicide where the causes are very likely to be varied and systemic. I doubt you will find one root cause. You may find at Foxcon: low wages (and the pressures that brings on as one factor - Foxconn doubled wages recently), lack of joy in work (to an extreme level - truly feeling like a cog in a machine with no hope), "imitation effect", homesickness (moving to the factor hundreds or miles from home and living in a dorm), youngness (hormones, lack of life experience, exaggerated importance... - similar at Cornell and Foxconn), perhaps abusive practices in the factory, perhaps other psychology in the factory (low light, long hours, painful work...), perhaps bullying of peers...

I think a good systemic solution will look at what I think all management should look at: practicing respect for people and creating joy in work. But that isn't an overnight solution, even if they wanted to pursue that strategy (which I don't see any evidence that they do). It will take time to change the system. It is something that I think can address the systemic root causes.

Related: Auto Manufacturing in 2009: USA 5.7 million, Japan 7.9 million, China 13.8 million - Motivate or Eliminate De-Motivation - USA, China and Japan Lead Manufacturing Output in 2008 - China’s Manufacturing Economy

Friday, March 26, 2010

Preaching False Ideas to Men Known to be Idiots

Re: Yes, Debt Matters

Over the last several weeks I've been contemplating how things have changed in my still relatively short lifetime... how the word "freedom" has somehow morphed to mean "I work so others get free stuff" or perhaps even better "I better stop working so I can get free stuff." Personal accountability has gone out the window, an increasing number of people pay no taxes - coming dangerously close to the 51% tipping point where tax policy will be set by those who don't pay anything, and somehow all kinds of new "rights" have magically appeared in the Constitution."


A huge amount of debt is bad, like the amount we have taken on. Those that have continued to elect politicians that pour on the debt the last 30 years should be ashamed of ourselves, but we do not seem to be. We shouldn't elect people that year after year pay out money they don't have with the (unspoken) promise of future taxes.

Saying people don't pay taxes when they often pay much higher proportional taxes than the rich is very misleading. Pretending that income taxes are the only taxes is just not true. When people try to say a small percentage of people pay taxes, usually they mean there is a significant portion that don't pay federal income taxes. Which is, of course, not the same thing as not paying taxes.

I'm not sure where your claim of 51% pay no taxes comes from but it sounds like the extremely misleading "data" presented by those that think the poor are somehow responsible or to blame and we should be doing more to support the lifestyles of the rich.

Buffett Slams Tax System Disparities

Buffett cited himself, the third-richest person in the world, as an example. Last year, Buffett said, he was taxed at 17.7 percent on his taxable income of more than $46 million. His receptionist was taxed at about 30 percent.


Interview with Warren Buffett:

Most of my income is taxed at 15 percent, and-- and doesn't pay a payroll. Mainly it's dividends and capital gains. And if you look at the For-- Forbes 400, a bunch of my fellow rich guys-- they will-- their tax rate overall to the federal government will be less than that of their receptionist.
...
I'll bet a million dollars against any member of the Forbes 400 who challenges-- me that the average for the Forbes 400 will be less than the average of their receptionists. So, I'll give 'em an 800 number. They can call me. And the million will go to whichever charity the winner-- designates.


Criticize the politicians that have for decades passed budgets that hike the taxes in the future to give their current voters a false sense of well being (because they know the voters won't think about the future costs the largess [big tax cuts now without spending cuts, for example, are not in fact tax cuts in any real sense, they are just shifting taxes to the future. But that is not what the marketers peddling those giveaways say, of course] today costs). Criticize the voters for mortgaging a significant amount of future economic wealth of their country to such charlatans. I concur with such criticisms.

But I get frustrated with attempts to distort people's perceptions with misleading data. The debt problems are not because the poor are paying too little in taxes.

We spent like crazy in the last 10 years. That is a huge part of the problem - almost no-one disagrees with this. We reduced taxes on the rich. That is another huge part of the problem - some disagree with this. I can understand people feeling differently, that is their choice. But I see any attempt to market giveaways to voters today, that sticks a huge bill to those in the future as poor policy. Cutting taxes is fine as long as you cut spending a the same time (and you don't rely on fake financial projections to justify your current largess, of course).

We blow hundreds of billions a year in a very poorly run health system (again a problem that has existed and grown for decades). One can argue the current attempts makes it worse. One can't argue we elected people that have done nothing significant about it for decades.

No one must buy our debt. I have, for more than a decade, thought the main reason Japan and China buy so much of our debt is not because it is wise investment but for other economic reasons (and some political reasons). They wish to keep the dollar value high and allow the USA to buy their goods. I think they would be wise to massively reduce those purchases. And I suspect they shall. But we shall see.

It isn't tricky. Those of us that have elected politicians that created huge debt loads (by increasing spending or reducing current taxes) created the need for huge taxes for the future to pay off that debt. We continue to elect them so it is just playing out the way we chose.

Unfortunately we suffer a great deal from

1) the inability to think beyond the current year with any degree of sense. We act like 8 year olds. That isn't a good thing for adults to do on matters such as long term saving and debt. We not only do it with those we elect but also in our own retirement accounts.

2) the intellectual discourse on the most important and complex decisions our country makes is about at the level of a Coke commercial. Again this is something we chose. If we didn't acknowledge/accept ill informed campaigns on matters of pubic policy then talking heads would actually be replaced with thoughtful people that detailed the cost and benefits of options and provided alternatives they support. Instead we want simple minded marketing minds to set the policy landscape so we get decisions based on fear, rhetoric, oversimplifications, marketing gimmicks, manipulation, demagoguery...

H. L. Mencken said it well, a demagogue as "one who will preach doctrines he knows to be untrue to men he knows to be idiots." I can't tell how many of our politicians are demagogues and how many are the idiots that demagogues play for fools. But an awful lot of them are in one or the other camp. I imagine many think they are demagogues, but I bet quite a few are really fools.

Saturday, December 05, 2009

Interactions and Data Analysis

Re: Context Matters

Multivariate testing is great. And it a great way to determine interactive factors - which are essentially not possible to determine with one variable at a time testing (though a smart person can see indications within this type to view them).

Your example though seems to largely be about properly stratifying the data for optimization. While it is always difficult to tell with short examples it seems like it may well be that you have 2 different audiences and a solution that, for example, intercepts the search engine traffic and gives them some context might help a lot (you see this on many blogs where they say - "I see you find us search on X - you may also be interested in Y...

But the biggest point I think your story illustrates is the importance of the experimenter. They need to think. Their role is not just to calculate some numbers and whatever number is higher wins. George Box: "it’s not about proving a theorem, it's about being curious about things. There aren't enough people who will apply [DOE] as a way of finding things out."

Related: YouTube Uses Multivariate Experiment To Improve Sign-ups 15% - Using Design of Experiments - Statistics for Experimenters

Monday, August 24, 2009

Death at the Hands of Others Today is Actually Historically Low Now

Why is There Peace?

When the archeologist Lawrence Keeley examined casualty rates among contemporary hunter-gatherers—which is the best picture we have of how people might have lived 10,000 years ago—he discovered that the likelihood that a man would die at the hands of another man ranged from a high of 60 percent in one tribe to 15 percent at the most peaceable end. In contrast, the chance that a European or American man would be killed by another man was less than one percent during the 20th century, a period of time that includes both world wars. If the death rate of tribal warfare had prevailed in the 20th century, there would have been two billion deaths rather than 100 million, horrible as that is.
...
The sociologist Norbert Elias suggested that European modernity accelerated a "civilizing process" marked by increases in self-control, long-term planning, and sensitivity to the thoughts and feelings of others.
...
Whatever its causes, the decline of violence has profound implications. It is not a license for complacency: We enjoy the peace we find today because people in past generations were appalled by the violence in their time and worked to end it, and so we should work to end the appalling violence in our time. Nor is it necessarily grounds for optimism about the immediate future, since the world has never before had national leaders who combine pre-modern sensibilities with modern weapons.


It is good to remember that statistically things are often much much better today than 100 years ago or 200 years ago. We still have much to be ashamed of. We need to do much better for the future of humanity but in many many ways we have made great progress.

Related: Leading Causes of Death - Global Cancer Deaths to Double by 2030 - Too Much Stuff - Water Wars Break Out in India

Sunday, January 20, 2008

Don't Lock Your Content Inside a Proprietary System

Has your Facebook account been “erased” by Facebook?

ever since Facebook blocked my account for a little less than a day people have been calling me with some real sob stories about how their accounts got turned off by Facebook and that they have no recourse.


What to do? Just don't join networks where the primary value is locked up inside them. If you don't control most of your content don't join (and if the value is locked up inside their system don't bother, or at least don't invest much time at all so little is lost in the event of a problem).

Hoping companies will care and be competent enough to manage what you invest in creating just doesn't seem like a worthwhile risk to take to me. They will have all sorts of issues to deal with and either out of plain bad management or because they decided it is easier and cheaper to destroy (deleting it, breaking support for code you relied on...) what you have created they are very likely to not value your investment. Most likely, only if their belief of what is in their interests happens to align with what is in your interests will you be in someone decent shape (even then you are susceptible to them managing poorly).

For social networks I can see they might add value by providing useful tools to improve connections (but if they can't figure out a way to be open and interact easily with mainly internet based content don't waste your time with their old proprietary thinking model). I just don't see much need to participate in an enterprise where I would have to invest my time and energy and content and hope that the company decides not to be evil for the rest of the time I want to deal with them.

Keep most of your content under your control. For example even if your content is in Blogger, the ability to backup (and move) your blogger blog essentially leaves the content in your control. Then if Google decides to be evil you just take you backup and post it elsewhere.

Wednesday, January 09, 2008

Do Red Light Cameras Make for Safer Intersections?

Comment on Red-Light Cameras Increase Accidents: 5 Studies That Prove It:

Ok, so lets say that the studies are conclusive. What actions do you suggest? If safety is important i would guess reducing accidents is important. Does that mean actions you suggest such actions as removing red light cameras and spending money to re-engineer dangerous intersections? If so what money should be used to re-engineer dangerous intersections? Gas tax funding? Or is just eliminating red light cameras what you suggest? Any suggestions on reducing the more than 40,000 people killed every year in the USA in traffic accidents? I would guess (without any evidence) red light cameras cannot account for a significant number of those deaths.

Related: D.C. Red-Light Cameras Fail to Curb Accidents - Leading Causes of Death

Friday, August 17, 2007

Voting Machine Failures

Diebold vote-hack roundup provides a series of quotes and links on problems with electronic voting machines:

"Electronic voting machine breakdowns have wreaked havoc in recent state primaries, disenfranchising thousands of voters and calling into question election results, " said Holly Jacobson co-director of Voter Action. "While we are pleased with today's verdict, the serious security flaws inherent in electronic voting technology - confirmed in a new study by Princeton University experts last week, underscore the need for more secure and verifiable voting systems. Paper ballots do not fail to boot up and can be reliably counted, audited and recounted. This is why half the counties in the country are using them. Maryland 's Governor Ehrlich announced his support for returning his state to paper ballots earlier this week".


Our previous posts on this topics: Security of Electronic Voting

Friday, July 06, 2007

Data on You

Interesting site: Attentiontrust to look at later.

Tuesday, February 13, 2007

Time Series Data Library

Time Series Data Library - lots of time series data on all sorts of things: economics, sports, chemistry, crime, health...

Thursday, November 30, 2006

The Increase is Evidence of a Decrease???

Two consecutive sentences from a Washington Post article, Mortgage Rates Drop to 6.14 Percent:

Home prices grew 0.86 in the third quarter of this year, the slowest pace since 1998, the Office of Federal Housing Enterprise reported today.

This slow growth "provides more evidence that the long-forecasted national depreciation in housing prices is occurring," the agency's director, James B. Lockhart, said in a statement.


So the increase is evidence of the decrease? What!!!!

Related: Coming Collapse in Housing? - 30 Year Fixed Rate Mortgage Rates - Financial Literacy blog posts