Obamacare rollout status report: central place for updates

Page 9 - Seeking answers? Join the AnandTech community: where nearly half-a-million members share solutions and discuss the latest tech.

First

Lifer
Jun 3, 2002
10,518
271
136
I mentioned it in another thread but I'll say it here too: it's my opinion that the Manhattan Institute "study" behind this article used a seriously flawed methodology.

Can you elaborate? Is the premium increase likely significantly more or less or too preliminary?
 

fskimospy

Elite Member
Mar 10, 2006
84,827
49,531
136

LOL @ the Manhattan Institute.

What's awesome is that to end up at their 41% figure they simply took every state's number that they generated (and even that is probably suspect knowing the record of the MI) and averaged it. Yep, that means that the +40% premiums faced in North Dakota (population, 700,000) are equal to the -40% premiums found in New York State (population, 20,000,000).

I have no interest in trying to re-weight their numbers for population size and who knows? It might come out similarly (although I doubt it.) Regardless, that's a stats 101 error right there. This is why friends don't let friends listen to output from ultra right wing think tanks.

Seriously, this is at least the second or third time the MH has come out with some embarrassingly bad analysis.
 

sactoking

Diamond Member
Sep 24, 2007
7,547
2,759
136
Can you elaborate? Is the premium increase likely significantly more or less or too preliminary?

First, let me disclaim: part of my initial interest in the Forbes article and study was that Nevada was called out for having the highest % increase of any state, 179%, while the second place state, New Mexico, was almost 40 points behind at 142%. That may create an actual or perceived conflict of interest, so please keep that in mind as you read what I have to say.

Pre-submission Edit: Without writing a novel, my biggest beef is that I can't replicate their results. Their methodology for rate comparisons says:
For ACA rates, we created state-level averages by averaging rates for the five cheapest plans across all counties in a state. The data was sourced from ValuePenguin and because the ACA bans denials based on pre-existing conditions, there is no need to develop a weighted average of these rates.

That's a very simple methodology, one which should be easily repeatable with access to the data (which I have in abundance). Yet I cannot replicate their results.

Ignoring that I can't replicate their results, they seem to have ignored off-exchange prices. Considering that they claim the study shows "the gross impact of the ACA on health insurance premiums in the individual market", ignoring a substantial part of the individual market, and the resultant lower premiums, is deceptive.
 

First

Lifer
Jun 3, 2002
10,518
271
136
^ Very interesting, I hadn't noticed the weighting eskimospy or that you can't reproduce said data Sactoking. Would be helpful in trying to corroborate Roy's conclusions.
 

sactoking

Diamond Member
Sep 24, 2007
7,547
2,759
136
^ Very interesting, I hadn't noticed the weighting eskimospy or that you can't reproduce said data Sactoking. Would be helpful in trying to corroborate Roy's conclusions.

Interesting indeed.

I went to ValuePenguin and searched by county in Nevada for Bronze rates for a 27yo. I took the five least expensive plans per county and averaged the prices. I then averaged the 14 county prices into one master average. Manhattan Institute said the average should be ~$304; I calculated $274. I thought maybe they used Silver rates (even though their methodology clearly says "five least expensive plans") but my result was ~$334.

I also accounted for the fact that ValuePenguin only displays on-exchange rates. In Nevada we have a very robust off-exchange market, so I thought that might be a factor. Nope, our off-exchange rates are lower than on-exhange, so that doesn't seem to fit their result.

I also note that in our 7 or 8 rural counties only two plans are listed (we have trouble getting rural coverage). If I sort ValuePenguin by metal tier I don't get 5 full plans for my average. So, I took the 5 plans regardless of tier in the rurals, but that didn't match the MI result either (and would have necessitated a similar methodology in the non-rural areas, dropping the cost as the Cat plans are included).

So, unless I'm just misunderstanding their simple methodology, their result is not reproduceable.

(Then add in other glaring errors, like not using off-exchange prices).
 

First

Lifer
Jun 3, 2002
10,518
271
136
Interesting indeed.

I went to ValuePenguin and searched by county in Nevada for Bronze rates for a 27yo. I took the five least expensive plans per county and averaged the prices. I then averaged the 14 county prices into one master average. Manhattan Institute said the average should be ~$304; I calculated $274. I thought maybe they used Silver rates (even though their methodology clearly says "five least expensive plans") but my result was ~$334.

I also accounted for the fact that ValuePenguin only displays on-exchange rates. In Nevada we have a very robust off-exchange market, so I thought that might be a factor. Nope, our off-exchange rates are lower than on-exhange, so that doesn't seem to fit their result.

I also note that in our 7 or 8 rural counties only two plans are listed (we have trouble getting rural coverage). If I sort ValuePenguin by metal tier I don't get 5 full plans for my average. So, I took the 5 plans regardless of tier in the rurals, but that didn't match the MI result either (and would have necessitated a similar methodology in the non-rural areas, dropping the cost as the Cat plans are included).

So, unless I'm just misunderstanding their simple methodology, their result is not reproduceable.

(Then add in other glaring errors, like not using off-exchange prices).

Yes very interesting and frankly odd Manhattan wouldn't reproduce the numbers and math behind their study. I can't see any downside in it, well other than being called out and/or possibly nitpicked by their political opposition.
 

PlanetJosh

Golden Member
May 6, 2013
1,815
143
106
I can get on the CA site, it seems to work ok now. I created an account and compared plans. I didn't choose any of the plans because I decided to use VA Health Care (Veterans Admin) for the next few years. I know the VA will probably not give the fancy health care I could get with Anthem/Blue Shield or Kaiser but I'm in my late 50's so I'll be going on Medicare in the not too distant future. So I may as well avoid having to pay premiums until then.
 

spacejamz

Lifer
Mar 31, 2003
10,847
1,492
126
Sebelius is setting up the cushion for the low enrollment numbers that will be released this month as well as the possiblity that the site might not be fully functional by the promised 11/30 date....

http://www.nbcnews.com/health/sebelius-faces-more-questions-health-law-8C11542596

"We are not where we need to be," Sebelius told a hearing of the Senate Finance Committee. "It is a pretty aggressive schedule to get to the end of the punch list by the end of November."

As a result, not very many people have been able to sign up yet. "I can tell you our early enrollment numbers will be very low," Sebelius said.


Anyone seen any figures on how much this concentrated effort of working nights/weekends is going to cost the tax payers? Contract workers love their overtime...wonder what their hourly billing rate is....
 

werepossum

Elite Member
Jul 10, 2006
29,873
463
126
Interesting indeed.

I went to ValuePenguin and searched by county in Nevada for Bronze rates for a 27yo. I took the five least expensive plans per county and averaged the prices. I then averaged the 14 county prices into one master average. Manhattan Institute said the average should be ~$304; I calculated $274. I thought maybe they used Silver rates (even though their methodology clearly says "five least expensive plans") but my result was ~$334.

I also accounted for the fact that ValuePenguin only displays on-exchange rates. In Nevada we have a very robust off-exchange market, so I thought that might be a factor. Nope, our off-exchange rates are lower than on-exhange, so that doesn't seem to fit their result.

I also note that in our 7 or 8 rural counties only two plans are listed (we have trouble getting rural coverage). If I sort ValuePenguin by metal tier I don't get 5 full plans for my average. So, I took the 5 plans regardless of tier in the rurals, but that didn't match the MI result either (and would have necessitated a similar methodology in the non-rural areas, dropping the cost as the Cat plans are included).

So, unless I'm just misunderstanding their simple methodology, their result is not reproduceable.

(Then add in other glaring errors, like not using off-exchange prices).
Very interesting, but wouldn't your numbers still show a 100%+ increase?

If so, is that because Nevada had a high percentage of crap health insurance plans, or is there something I'm missing?

Manhattan may have used the averages for rural and urban markets weighted by percentage population. Regardless, studies without the math and methodology published are virtually worthless, as statistics can say any damned thing you want them to say.

Sebelius is setting up the cushion for the low enrollment numbers that will be released this month as well as the possiblity that the site might not be fully functional by the promised 11/30 date....

http://www.nbcnews.com/health/sebelius-faces-more-questions-health-law-8C11542596

Anyone seen any figures on how much this concentrated effort of working nights/weekends is going to cost the tax payers? Contract workers love their overtime...wonder what their hourly billing rate is....
But to be fair, the other side of the ACA, destroying people's existing health insurance plans, seems to be ahead of schedule.

As far as cost figures go, I don't know any I'd trust. Seems to me that all the figures are generated either to make the ACA look successful or to make it look more unsuccessful. One could perhaps average them, but then the side willing to lie the most egregiously gets its point made regardless of merit.
 

spacejamz

Lifer
Mar 31, 2003
10,847
1,492
126
I'd like to see updated CBO projections on the cost and economic impact of Obamacare. I suspect it's going to be a helluva more costly than originally claimed.

Fern

Who woulda thunk that could/would ever happen???
 

sactoking

Diamond Member
Sep 24, 2007
7,547
2,759
136
Very interesting, but wouldn't your numbers still show a 100%+ increase?

If so, is that because Nevada had a high percentage of crap health insurance plans, or is there something I'm missing?

Manhattan may have used the averages for rural and urban markets weighted by percentage population. Regardless, studies without the math and methodology published are virtually worthless, as statistics can say any damned thing you want them to say.

My office has taken the position that any comparison of "pre-ACA" rates and "post-ACA" rates is irresponsible; the plans just aren't the same. I can't replicate MI's results so I cannot say that I understand their methodology based on the sparse description provided, so I can't speculate if the "real" increase is 100+% or not.

Your bringin up "crap" plans is another issue I have with the study. I've mentioned that the methodology appears unreplicable and I've mentioned that only using exchange plans is hugely misleading. What I haven't mentioned is their determination of the "pre-ACA" rates.

Setting aside their assumptions on upcharging, their tactic of "compare the five least expensive plans to the five least expensive plans" misses one key component: enrollment. Because the ACA mandates the ten essential health benefits a reasonable assumption would be that plan enrollment will cluster. What I mean is that a hypothetical Plan A and Plan B, offering roughly the same benefits at roughly the same prices, will have comparable enrollments. This is very clearly not the case in the "pre-ACA" world. Two plans, let's call them Plan Y and Plan Z, could have very different benefits and very different premiums and the enrollments will vary widely as well. If a bare-bones Plan Z costs 1/5 what Plan Y costs but has an enrollment figure 1/100 of that of Plan Y (since the risk-averse avoid it) then Plan Z is not representative of anything, should be considered an outlier, and should not be included in the study. Manhattan Institute didn't control for that.

Put another way: Before the ACA I have 6 plans in my market. 5 of them cost $20/month and each have an enrollment of 50 people. The sixth costs $300/month and has an enrollment of 99,750. After the ACA I have 6 plans, they all cost about $350/month, and they all have an enrollment of ~16,666 people. The Manhattan Institute will tell you that the "average" increase in my market was 1,650% but the real average increase is closer to 17%. The uncompensated use of statistical outliers invalidates statistical analysis.
 

werepossum

Elite Member
Jul 10, 2006
29,873
463
126
My office has taken the position that any comparison of "pre-ACA" rates and "post-ACA" rates is irresponsible; the plans just aren't the same. I can't replicate MI's results so I cannot say that I understand their methodology based on the sparse description provided, so I can't speculate if the "real" increase is 100+% or not.

Your bringin up "crap" plans is another issue I have with the study. I've mentioned that the methodology appears unreplicable and I've mentioned that only using exchange plans is hugely misleading. What I haven't mentioned is their determination of the "pre-ACA" rates.

Setting aside their assumptions on upcharging, their tactic of "compare the five least expensive plans to the five least expensive plans" misses one key component: enrollment. Because the ACA mandates the ten essential health benefits a reasonable assumption would be that plan enrollment will cluster. What I mean is that a hypothetical Plan A and Plan B, offering roughly the same benefits at roughly the same prices, will have comparable enrollments. This is very clearly not the case in the "pre-ACA" world. Two plans, let's call them Plan Y and Plan Z, could have very different benefits and very different premiums and the enrollments will vary widely as well. If a bare-bones Plan Z costs 1/5 what Plan Y costs but has an enrollment figure 1/100 of that of Plan Y (since the risk-averse avoid it) then Plan Z is not representative of anything, should be considered an outlier, and should not be included in the study. Manhattan Institute didn't control for that.

Put another way: Before the ACA I have 6 plans in my market. 5 of them cost $20/month and each have an enrollment of 50 people. The sixth costs $300/month and has an enrollment of 99,750. After the ACA I have 6 plans, they all cost about $350/month, and they all have an enrollment of ~16,666 people. The Manhattan Institute will tell you that the "average" increase in my market was 1,650% but the real average increase is closer to 17%. The uncompensated use of statistical outliers invalidates statistical analysis.
Perhaps a better way to say it might be that the "average" policy increase in your market was 1,650% but the average increase for comparable policies is closer to 17%. The people are going to be paying their actual increase regardless of the relative pre-ACA versus post-ACA plan value. However, your point about enrollment is spot-on and the actual average should be weighted by enrollment to have any validity.

However one says it, if the true cost of insuring 15% of Americans works out to be 17% on those of us already insured, I'll be relatively happy. I'd be even happier though if that were an even 17% on everyone rather than a relatively huge increase on the young.
 

Matt1970

Lifer
Mar 19, 2007
12,320
3
0

spacejamz

Lifer
Mar 31, 2003
10,847
1,492
126
Healthcare.gov crashed due to overwhelming demand on October 1? How about healthcare.gov crashed because it could only handle 1,100 logins...

http://www.foxnews.com/politics/201...andle-1100-users-day-before-launch-docs-show/

It's Fox, but at least they link to their source document (it's the second page).

At least it is consistent with Sebelius' story that they anticipated traffic spikes in December and February, so maybe she should October would be a very light month...LOL

How the hell has she not been fired/resigned over this clusterfvck yet??? It really won't matter though, I am sure that after her book deal and getting a high 6 figure 'consulting' job at one of Obama's friend's company, she should be set...
 

spacejamz

Lifer
Mar 31, 2003
10,847
1,492
126
Healthcare.gov crashed due to overwhelming demand on October 1? How about healthcare.gov crashed because it could only handle 1,100 logins...

http://www.foxnews.com/politics/201...andle-1100-users-day-before-launch-docs-show/

It's Fox, but at least they link to their source document (it's the second page).


Pretty pathethic that they didn't have enhanced monitoring tools on Oct 1 to get a high level picture of the marketplace activity...wonder if they had any monitoring tools at all...

“Two weeks ago, the tech team put into place enhanced monitoring tools for HealthCare.gov, enabling us to get a high-level picture of the marketplace application responding, and to measure how changes improve user experience on the site,” she said.
 

brycejones

Lifer
Oct 18, 2005
26,718
25,058
136
Healthcare.gov crashed due to overwhelming demand on October 1? How about healthcare.gov crashed because it could only handle 1,100 logins...

http://www.foxnews.com/politics/201...andle-1100-users-day-before-launch-docs-show/

It's Fox, but at least they link to their source document (it's the second page).

Their headline is horribly misleading. It says "ObamaCare website could only handle 1,100 users a day before launch, docs show"

Now the story actually gets it right but I wonder how many people will just pass the headline around.

As complex as the architecture they built seems to be I'm not shocked they started seeing response time issues so quickly. Another case study in why load and performance testing needs to be done and done early enough to give your dev teams time to make changes.

As an IT professional whoever ran this goat rope should be absolutely embarrassed it ticks off pretty much every one of the "don't do this" check boxes.
 

Svnla

Lifer
Nov 10, 2003
17,999
1,396
126
Their headline is horribly misleading. It says "ObamaCare website could only handle 1,100 users a day before launch, docs show"

Now the story actually gets it right but I wonder how many people will just pass the headline around.

As complex as the architecture they built seems to be I'm not shocked they started seeing response time issues so quickly. Another case study in why load and performance testing needs to be done and done early enough to give your dev teams time to make changes.

As an IT professional whoever ran this goat rope should be absolutely embarrassed it ticks off pretty much every one of the "don't do this" check boxes.

Because tests did not get started until two weeks before the roll out.

And no one bother to do any "top to bottom" testings as required = http://www.cbsnews.com/8301-18563_1...ed-final-security-requirements-before-launch/
 

sactoking

Diamond Member
Sep 24, 2007
7,547
2,759
136
I mentioned it in another thread but I'll say it here too: it's my opinion that the Manhattan Institute "study" behind this article used a seriously flawed methodology.

I just thought I'd follow up on this. I was able to replicate at least one of the source study's results, but I had to violate their stated methodology to do so. In order to get at the result I verified I had to use a statistical method that is misrepresentative of a true comparison study.
 
sale-70-410-exam    | Exam-200-125-pdf    | we-sale-70-410-exam    | hot-sale-70-410-exam    | Latest-exam-700-603-Dumps    | Dumps-98-363-exams-date    | Certs-200-125-date    | Dumps-300-075-exams-date    | hot-sale-book-C8010-726-book    | Hot-Sale-200-310-Exam    | Exam-Description-200-310-dumps?    | hot-sale-book-200-125-book    | Latest-Updated-300-209-Exam    | Dumps-210-260-exams-date    | Download-200-125-Exam-PDF    | Exam-Description-300-101-dumps    | Certs-300-101-date    | Hot-Sale-300-075-Exam    | Latest-exam-200-125-Dumps    | Exam-Description-200-125-dumps    | Latest-Updated-300-075-Exam    | hot-sale-book-210-260-book    | Dumps-200-901-exams-date    | Certs-200-901-date    | Latest-exam-1Z0-062-Dumps    | Hot-Sale-1Z0-062-Exam    | Certs-CSSLP-date    | 100%-Pass-70-383-Exams    | Latest-JN0-360-real-exam-questions    | 100%-Pass-4A0-100-Real-Exam-Questions    | Dumps-300-135-exams-date    | Passed-200-105-Tech-Exams    | Latest-Updated-200-310-Exam    | Download-300-070-Exam-PDF    | Hot-Sale-JN0-360-Exam    | 100%-Pass-JN0-360-Exams    | 100%-Pass-JN0-360-Real-Exam-Questions    | Dumps-JN0-360-exams-date    | Exam-Description-1Z0-876-dumps    | Latest-exam-1Z0-876-Dumps    | Dumps-HPE0-Y53-exams-date    | 2017-Latest-HPE0-Y53-Exam    | 100%-Pass-HPE0-Y53-Real-Exam-Questions    | Pass-4A0-100-Exam    | Latest-4A0-100-Questions    | Dumps-98-365-exams-date    | 2017-Latest-98-365-Exam    | 100%-Pass-VCS-254-Exams    | 2017-Latest-VCS-273-Exam    | Dumps-200-355-exams-date    | 2017-Latest-300-320-Exam    | Pass-300-101-Exam    | 100%-Pass-300-115-Exams    |
http://www.portvapes.co.uk/    | http://www.portvapes.co.uk/    |