PDA

View Full Version : Another article about networks questioning Nielsens


grinner
11-17-2003, 08:00 AM
Network Execs Question Nielsen Accuracy
Sun Nov 16,12:16 PM ET

Add Entertainment - AP to My Yahoo!

By DAVID BAUDER, AP Television Writer

NEW YORK - Television's biggest mystery this season has nothing to do with what's on the air. Everyone in the industry is talking about it: Where have all the young viewers gone? Or have they gone anywhere at all?



It's just another chapter in the TV's dysfunctional marriage to the Nielsen ratings, where breaking up would be more painful than staying together.

Nielsen Media Research's claim that prime-time viewing among men aged 18-to-34 has dropped by 7 percent this season is hotly disputed by TV networks, where overall viewership is down this season. The debate has renewed long-running tensions between broadcasters and the company they pay to measure their audience.

Given Nielsen's monopoly, the clash is inevitable. The research company's numbers decide where billions of dollars worth of advertising is spent and whether TV shows — even entire networks — live or die.

Several broadcast executives wonder whether Nielsen is unfit for a wired world with hundreds of networks, digital video recorders and impatient channel surfers.

"I do worry about technology's advances being ahead of Nielsen's ability to measure it," said Alan Wurtzel, research president at NBC, which has lost, on average, more than a million viewers a week from last year. "I do believe that has everything to do with being a monopoly."

The monopoly is as old as the medium, ever since Arthur Nielsen translated the measurement system that he devised for radio in 1942 to television. The company has been largely impervious to challenge; one notable attempt went under in 1999.

Criticism from the networks grows loud whenever Nielsen detects an unexpectedly large drop in TV audience size.

"A few years ago, (young male viewership) was at a record high, and there was no outrage expressed against that," sniffed Jack Loftus, Nielsen spokesman.

One of the industry's top number-crunchers, CBS chief researcher David Poltrack, believes this autumn's ratings drop can be tied to 105 men who aren't pushing enough buttons.

Nielsen gathers its ratings through a sample of 5,100 homes nationwide. Among men aged 18-to-24, where the bulk of the viewership decrease is concentrated, that's just 600 people. Poltrack wants Nielsen to investigate whether a subset of these men — just 105 of them — are unreliable because they really don't want to participate in Nielsen's study.

Wurtzel has suggested that Nielsen has worked hard to recruit new Hispanic viewers into its sample, and that they have proven less reliable than past participants in punching the buttons that record what they're watching.

Almost every time there's a blip in the statistics, the sample is responsible, Wurtzel said.

After a long investigation, a mysterious drop in TV watching in 1972 was traced to Nielsen using a new glue to attach its monitoring device to televisions. When the TV set warmed from use, some of the monitors loosened and dropped off.

"We have billions of dollars riding on this," Wurtzel said. "We can't afford to have mistakes."

Loftus dismisses Wurtzel's theory, saying the number of new Hispanic viewers is too small to make much difference. Nielsen is looking into Poltrack's ideas, but said it has found no evidence of a large drop in participation.

There's always the obvious explanation: maybe men are actually watching less TV.



Kate Lynch, global research director at the advertising firm Starcom USA, understands why Wurtzel and his network colleague don't want to believe that.

"All he can sell is his audience," she said. "If they're missing, he's got to blame somebody."

The networks are concerned that Nielsen's measurement system, which worked well in the days of three big broadcast networks, is archaic today. Viewership is so small for some of the tiny cable networks that Nielsen can barely offer a reliable picture of who's watching.

Nielsen admits that its sample does not include homes with digital video recorders — machines like TiVo (news - web sites) — because it can't measure shows that are recorded and watched later. Networks say bypassing these tech-savvy homes means Nielsen is bypassing some of the most dedicated TV viewers, perhaps skewing their survey.

It will be at least a year or two before DVR homes are included, Loftus said.

Nielsen has committed to doubling its national sample of 5,100 homes within two years. Getting ready for the days of digital TV signals, Nielsen is experimenting with a device that reads codes embedded within the TV picture.

The company has also tested systems that would make it easier for participating families, such as an electronic sensor of who is watching, but found them to be more expensive than clients were willing to pay, Loftus said.

Nielsen has been very aggressive, Loftus said, but its ability to cope with a rapidly changing world is a legitimate question.

"We all have a stake in this and we all have to work together, and that's what we're trying to do," he said.

Ultimately, there's some question about how aggressive the networks want Nielsen to be.

Networks and advertising agencies spent $60 million in the 1990s to bankroll a Nielsen competitor, Statistical Research, Inc., that experimented with technologies more advanced than anything Nielsen was using at the time.

When SRI was operating, Nielsen "was never more responsive to their customer base," Wurtzel said.

Yet faced with the decision in 1999 of whether to fund SRI fully so it could put its experiments in operation, the networks balked.

"In many ways the industry has what it bargained for," said Gale Metzgar, SRI president. "They did let (SRI's system) go down the drain."

Starcom's Lynch, who believes Nielsen is doing "an OK to good job," said networks are suspicious of innovation for fear of what new measurements will tell them.

For instance, advertisers have unsuccessfully tried to get Nielsen to measure how many people are watching commercials. One recent non-Nielsen study of DVR users found three-quarters of them fast-forwarded through ads; networks have no interest in publicizing that, she said.

"They want good numbers," she said. "Not accurate numbers."

Poltrack, who believes Nielsen has improved its service but also worries about its ability to deal with new technology, conceded a certain fear of the unknown.

"What we need, what we look for Nielsen to provide, is stability," he said.

The current flap over young viewers is familiar; networks took out magazine advertisements in 1996 to complain when Nielsen reported a dropoff in pro football viewership that year.

"This problem is here today and will be gone tomorrow and then we'll forget about it," Metzgar said. "Then, five years from now, another problem will crop up."

stellar
11-17-2003, 08:32 AM
Actually I tend to believe that the accuracy is far greater for the broadcast networks than it is for basic cable. Statistics isn't an exact science, but it's pretty close when the sample is large. And the sample is large enough for the networks, not large enough for basic cable.

I can't believe the gaul of the networks... thinking that we'll watch their crap no matter how bad it is. And if something shows that we're not watching their crap, then there must be something wrong with the technique used to measure what we're doing because, as everyone knows, we're just a bunch of GD lemmings who'll watch anything as long as it's got bright flashing lights. Puhlease.

The real reason young male viewership has dropped 7% is because we're all watching Farscape reruns on DVD.

mycattoldme
11-17-2003, 09:22 AM
Here is another one: From TV Week

Nielsen: Finding Lost Boys
Many Network Clients Challenge Data, Continue to Raise Questions About Ratings Methodology

By Michele Greppi

Nielsen Media Research this week will deliver to its clients a white paper whose bottom line is expected to be that there is no need to correct anything in Nielsen's methodology.

It's a message guaranteed to anger the TV rating agency's clients, who have long been frustrated that Nielsen is their only source of such data. They have been particularly troubled this season by steep declines in young male viewership.

Nielsen spokesman Jack Loftus said the white paper will include recaps of three months of data produced by Nielsen for itself and at the special request of clients, as well as analysis that supports Nielsen's contention that the disappearing act pulled by 18 to 34 male viewers during the past three months is correcting itself and is not a reflection of a flaw in Nielsen's National People Meter sample.

"The sample breakdown is at a record quality high," said Mr. Loftus.

The season-to-date decline in 18 to 34 men's prime-time TV usage was at 8 percent last week. "If you trend the data, it is right on trend for the past 10 years," Mr. Loftus said.

That brought a quick reaction from some TV executives who have been troubled by the numbers, which ultimately translate into revenue from advertising based on the size of the audience.

"I can't believe they're actually saying that," said one network executive.

"Their own numbers suggest it is not correcting itself," said another.

Indeed, Nielsen is certain to find such intuitive assertions hotly debated by network research executives, who say none of the data given to them by Nielsen is consistent with such an optimistic view.

The debate over the missing young men came to a boil last week after an NBC analysis pointed to young Hispanic men who are new to the National People Meter sample as a possible explanation for skewed results."I am not suggesting that what we found is the answer," said Alan Wurtzel, NBC's president for research and media development, who has been among the more vocal questioners of Nielsen's methodology.

Then CBS suggested that Nielsen had laid the foundation for the steep defections by letting a disproportionate number of historically "problematic" survey participants-young men living in a household not headed by themselves-into the 5,100-home National People Meter sample this year as it attempted to meet client requests for a survey that better reflects the country's demographic makeup.

David Poltrack, executive VP for research for CBS and UPN, asked Nielsen to compare the behavior of the men 18 to 34 who were in the national sample last year and are still in it this year. That analysis showed that in 40 percent to 50 percent of the unified sample, young men are actually watching more television and that declines in viewership are "concentrated in a relatively small percent of the overall sample."

"Of all the men 18 to 34 in the sample, 20 percent are accounting for 70 percent of the decline," Mr. Poltrack said. "Now, we look at that 20 percent and the first thing we notice about them is that the young men in that 20 percent are significantly more likely to live in homes headed by someone else, as opposed to young men living in their own homes.

"Throughout the history of the Nielsen system and of measuring audiences, this has always been the most problematic group, because these young men living at home with their parents, with other relatives, or whatever, tend to be involuntary participants in the survey. Someone else agreed to do the survey and they were dragged into it reluctantly," Mr. Poltrack said. "As a result, they've been, as a group, the least diligent in their button pushing. They've caused the most problem for Nielsen over the course of this People Meter measurement era.

"When we see the decline concentrated among this particular group, the red flags automatically go up and we say, 'Oh, them again.'"

When the issue first arose, Nielsen suggested one factor might be soldiers stationed in Iraq. However, that is not expected to be addressed in the white paper. What is likely to be mentioned are other explanations ranging from attendance at college (while the young man remains listed at home as a zero viewer) to increased use of other technologies. "If we took DVDs, video games and the Internet," Mr. Loftus said, "it might account for less than half of it."

The WB last week compared October diaries from the top 25 markets (which represent some 47 percent of the country) to data from the October national sample and found an unusually high level of discrepancy, even when the data was drawn from the same markets. The comparison showed that the level of men 18 to 34 using television was actually up 1.5 percent among those filling out diaries, while it was down 6.2 percent for the demo in the national metered survey.

Moreover, The WB's analysis showed year-to-year declines among men 18 to 34 to be smaller in the local diary sample than they were in the national metered sample. For The WB, that translated into a 20 percent decrease nationally while the audience segment registered flat in the 25-market diaries. ABC was down 19 percent nationally and down 12 percent in the diaries. CBS was down 30 percent nationally and down 15 percent in the diaries. NBC was down 26 percent nationally and 14 percent locally. UPN was off 28 percent nationally and down 21 percent in the diaries.

The anomaly was Fox, whose strong postseason baseball performance was used to explain much of the displacement of young men in October. Fox showed a 44 percent increase in the diaries, which included five big-city baseball markets, vs. a smaller 39 percent increase in the national metered sample.

The WB data said the level of men 18 to 34 using television (otherwise known as the PUT level) in the diary samples was up 1.5 percent, while the national sample showed the same PUT level down 6.2 percent.

A 25-market "cutback" from Nielsen (a report on only those markets) showed the PUT levels at plus 1.2 percent and minus 7 percent, respectively.

Mr. Loftus explained the difference between the two samples as an indication that "the meter is more sensitive."

"This leaves us feeling a little schizophrenic," said The WB Television Network co-Chairman Garth Ancier. "On the one hand, we're very excited for the success many of our stations are having selling, on average, basically the same ratings as last year, the best in our history; and at the same time, we're scratching our heads as to why the national sample shows us down 19 percent year to year. So depending on which Nielsen sample you go by, The WB is either having a great year, or not so great, like many of the other networks to date."

Andy Fisher, the CEO of Cox Broadcasting, intends to run his own comparisons in which the national sample during the November sweeps is measured against the diaries and local meters. He has been told by Nielsen that such data will not be available to him until after the November book is published.

The Atlanta-based group executive's skepticism of local People Meter methodology is well-known. "The whole process is skewed to smaller and smaller numbers," he said. He has frequently done local versions of Mr. Poltrack's unified sample analysis in search of the reasons for sudden dislocations in Cox markets.

Mr. Fisher is pessimistic about the solidity of meter-produced data to accurately reflect viewing in younger demographic groups. "To me the people meter has always been a time bomb waiting to explode for younger demographics," he said. "I consider it inevitable that younger demographics will be increasingly resistant to constantly pushing buttons to prove what they are viewing, just as they would be unwilling to make their beds or call their parents every half-hour or otherwise adhere to rigid requirements."#



© Copyright 2003 by Crain Communications

Eve11
11-17-2003, 09:49 AM
Statistics isn't an exact science, but it's pretty close when the sample is large.

Statistics is an exact science, it's just that it is the exact science of quantifying uncertainty. It is exact in the manner that it tells us, based on our assumptions and our sample size, exactly how sure we can be in our data-based estimates of real-world phenomena. It just so happens that as the sample size grows, we can be more confident in these estimates. Stats gets a bad reputation because like many powerful tools, people misuse it or misunderstand it. But it is based on as solid mathematics as real analysis and calculus and the like.

As for these articles, the data they cite does raise some suspicions. The main question they need to answer is whether the decline they see in this 20% of the sample is due to the fact that this demographic truly doesn't watch as much TV, or due to the fact that the men are less-than-eager participants. The networks can't say "we want a more accurate look at the true demographics of the country" and then get pissy if, when they get it, they discover that their estimates beforehand were too high. That's shooting the messenger. On the other hand, if the reason for the declines is solely due to the experimental design factors, then Nielsen needs to find a way to get better readings for this group. Diaries seem to be doing better. Perhaps they can augment the people-metering for this group with bi-weekly diaries or something, so the men can have a chance to say, "oh yeah, I forgot to push this button at that time." Or phone calls. Or hell, even email.

Davesnothome
11-17-2003, 10:06 AM
Well, if the Nielsin ratings are so inaccurate, does this mean the networks will bring back some of my favorite shows they've cancelled this season, based on these inaccurate ratings numbers? Also, while they are at it, how about bringing back a few shows from past seasons they cancelled, based on those same inaccuracies?

And since the Nielsin ratings are so inaccurate, will they please cancell CSI, ER, Friends, 60 Minutes, Survivor, Law & Order, Survivor, The Bachelor, The Simpsons, Everybody Loves Raymond, Smallville, American Idol and the West Wing, because obviously all those viewers who they say are watching those shows aren't really watching, because the ratings numbers are faulty!

Also could they get that hot, sexy good looking brunette, who lives a couple of doors over, to come over and knock on my door and make hot passionate love to me? (Actually this has nothing to do with the Nielsin ratings, but I figure if I'm making unrealistic requests, I might as well go for it! (g))

*******

When network executives's @$$ is so exposed for his lack of ability to produce programming his audience wants to watch, do you really expect them to take responsibility for there own mistakes? Never!!!! (vbg) They will always find someone else to blame!

Dave

grinner
11-17-2003, 10:13 AM
Originally posted by Davesnothome
And since the Nielsin ratings are so inaccurate, will they please cancell CSI, ER, Friends, 60 Minutes, Survivor, Law & Order, Survivor, The Bachelor, The Simpsons, Everybody Loves Raymond, Smallville, American Idol and the West Wing, because obviously all those viewers who they say are watching those shows aren't really watching, because the ratings numbers are faulty!
Survivor is so bad it is mentioned twice... you have my vote on those.