Help show Consumer Reports how it's done

[Brett]

How do you account for the fact that your sampling method is flawed and not scientific?

[Brett]

What type of verification process is used before your results are processed?

[thebigjimsho]

"Internet Research, Internet Results"

[dkozloski]

Garbage in, garbage out. It has all the appeal of global warming research.

[RightTurn]

Originally Posted by Brett

How do you account for the fact that your sampling method is flawed and not scientific?

Originally Posted by Brett

What type of verification process is used before your results are processed?

And most importantly, why aren't you a supporting member of this site since it is providing you with "data."

[concorso]

I've been hoping for awhile that someone would say something about this.

[gothicaleigh]

Originally Posted by mkaresh

Seems we can agree on one thing, after all.

As I've said before, currently there is no profit. And I'm not sure when there will be a profit. If there is eventually a profit, then I agree that it would make sense to compensate those forums that make it possible. We're simply not there yet.

Right now, all the costs of the reliability research come out of my pocket. And I don't ask people for donations, or even provide a way for them to donate. I'd rather they do the one thing I cannot do myself, and that's provide the data.

You're not being paid for the advertising on your site?

On the 2008 CTS page alone I see two ads for 'Cars Direct', one for 'Warranty Direct', and one for 'The Tire Rack'.

[HITMONEY]

I don't advertise on this site, I am an end user who feels that I gain from the discussions here and if it were not for these forums my knowledge about my chosen model and other models within my brand would be much less. This is why i support these forums, and others I gain from, at the very highest donation level. If I did not, I would feel like a free loader.

So for what it is worth, IMO, mkaresh is just another Pilot Fish on the underbelly of the internet trying to make a buck and has been called out on it. I would go out on a limb here and say there aren't many registered users on CF other than mkaresh himself who have come here from his site.

Oh and the thing about "but Sal said I could" doesn't mean that the users here have to feel all warm and cozy about it... and yes.. we may not own these forums but without us collectively they wouldn't exsist, so it is our business.

Bottom line... Put up or shut up.

[mkaresh]

Originally Posted by Brett

How do you account for the fact that your sampling method is flawed and not scientific?

All actual samples are flawed. Even with random sampling, the response rate is never close to 100% for this sort of research.

Just because the sample isn't random doesn't mean the research is not "scientific."

Two things control for the non-random sample:
1. People only report what happens after they join.
2. I'm not asking about opinions, but about whether or not an event happened.

If this were an opinion poll, it would be much more crticial to have a random sample. Consider the difference between asking people "is it raining" vs. "are you having a good day?" Even better, having people sign up today, then report whether it rains during the following week.

My results end up very similar to those of other surveys. They just include more detail, and are updated much more frequently and promptly.

[mkaresh]

Originally Posted by gothicaleigh

You're not being paid for the advertising on your site?

On the 2008 CTS page alone I see two ads for 'Cars Direct', one for 'Warranty Direct', and one for 'The Tire Rack'.

Those affliates generate maybe $150 of revenue per month. The server alone costs $50 a month. I have hundreds of dollars per month in other expenses, including the woman who goes through every response to check for errors. Dozens of forums have been assisting me with this research. Do the math.

[mkaresh]

The rest of you, I've already had this debate. There's nothing more I can say than I've already said, in most cases many times over.

[TaVern]

Originally Posted by Brett

What type of verification process is used before your results are processed?

mkaresh,

I haven't come across an answer to this question. If you have answered it, I apologize in advance and please direct me to your response. Thanks.

[mkaresh]

I run various checks on the responses that are submitted and the user-data collected in the process. Those that fail these tests are investigated. So far, very few such checks have been required, and so far all errant entries discovered have been caused by human error, not malicious intent.

[StealthV]

This debate from both sides is pure rubbish.

There should have been a "Warning - Cow Crap Crossing Ahead"

Due to the from both sides, the powers to be should the lot of them.



Really want to poke the eye of GM with a sharp stick? Rate the quality of the dealerships as well as the effectivity of marketing campaigns compared to the competition.

There's a reason people buy Yota$ and it's not because they build an exciting, quality car. Yota$ are rubbish supported with good marketing and dealers. Bunch of lemming$ on the Yota


P.S. GM and its dealers haven't figued it out yet.

[gothicaleigh]

Originally Posted by mkaresh

Those affliates generate maybe $150 of revenue per month. The server alone costs $50 a month. I have hundreds of dollars per month in other expenses, including the woman who goes through every response to check for errors. Dozens of forums have been assisting me with this research. Do the math.

So should I only be paying Sal for advertisement once I make what I consider a profit from his site each month? Your site is profiting from exposure here. What is more, it is absolutely dependent upon sites like this supplying the information you deal in.

Perhaps it is time you started paying for the privelege just like the rest of us.

Originally Posted by mkaresh

The rest of you, I've already had this debate. There's nothing more I can say than I've already said, in most cases many times over.

Being a supporting member here only costs $5 a month. No more excuses please.