Alaska

Rows edited: 1 AK 2021-02-26 positive: 55989 (was 55886) hospitalizedCurrently: 43 (was 45) hospitalizedCumulative: 1277 (was 1271) totalTestsViral: 1679675 (was 1671043) positiveTestsViral: 67580 (was 67403) negativeTestsViral: 1610023 (was 1601583) lastUpdateTime: 2021-02-26 08:59:00+00:00 (was 2021-02-25 08:59:00+00:00)

Rows edited: 1 AK 2021-02-26 positive: 55989 (was 55886) hospitalizedCurrently: 43 (was 45) hospitalizedCumulative: 1277 (was 1271) totalTestsViral: 1679675 (was 1671043) positiveTestsViral: 67580 (was 67403) negativeTestsViral: 1610023 (was 1601583) lastUpdateTime: 2021-02-26 08:59:00+00:00 (was 2021-02-25 08:59:00+00:00)

Alaska: Never reported negatives directly and always reported in specimens, removing total time series

Values Removed: Changes.txt

California: Never reported negatives directly, but did report in Total tests (people) until April 21, 2020. Removing time series from present to April 22, 2020.

Values Removed: Changes.txt

Washington DC: Never reported negatives directly, and has always reported encounters, removing total time series

Values Removed: Changes.txt

Georgia: Never reported negatives directly and always reported in specimens, removing total time series

Values Removed: Changes.txt

Kentucky: Never reported negatives directly and always reported in specimens, removing total time series

Values Removed: Changes.txt

New York: Never reported negatives directly and always reported in encounters, removing total time series

Values Removed: Changes.txt

Ohio: Never reported negatives directly and always reported in specimens, removing total time series

Values Removed: Changes.txt

Oregon: Never reported negatives directly, but did report in Total tests (people) until December 1, 2020. Removing time series from present to December 2, 2020.

Values Removed: Changes.txt

Texas: Never reported negatives directly and always reported in specimens, removing total time series

Values Removed: Changes.txt

Virginia: Never reported negatives directly and always reported in encounters, removing total time series

Values Removed: Changes.txt

Washington: Negatives were backfilled with values calculated from total tests (encounters)-confirmed cases in August 2020. Removing total time series.

Values Removed: Changes.txt

Alaska: Never reported negatives directly and always reported in specimens, removing total time series

Values Removed: Changes.txt

California: Never reported negatives directly, but did report in Total tests (people) until April 21, 2020. Removing time series from present to April 22, 2020.

Values Removed: Changes.txt

Washington DC: Never reported negatives directly, and has always reported encounters, removing total time series

Values Removed: Changes.txt

Georgia: Never reported negatives directly and always reported in specimens, removing total time series

Values Removed: Changes.txt

Kentucky: Never reported negatives directly and always reported in specimens, removing total time series

Values Removed: Changes.txt

New York: Never reported negatives directly and always reported in encounters, removing total time series

Values Removed: Changes.txt

Ohio: Never reported negatives directly and always reported in specimens, removing total time series

Values Removed: Changes.txt

Oregon: Never reported negatives directly, but did report in Total tests (people) until December 1, 2020. Removing time series from present to December 2, 2020.

Values Removed: Changes.txt

Texas: Never reported negatives directly and always reported in specimens, removing total time series

Values Removed: Changes.txt

Virginia: Never reported negatives directly and always reported in encounters, removing total time series

Values Removed: Changes.txt

Washington: Negatives were backfilled with values calculated from total tests (encounters)-confirmed cases in August 2020. Removing total time series.

Values Removed: Changes.txt

• [x] make GH issue
• [x] double check the metrics aren't being reported somewhere by the state
• [x] remove carried over values
• [x] null out source notes
• [x] null out WS2 values
• [x] update public note

no chart annotation added because we don't have a chart with this metric

Values removed: Changes.txt

• [x] make GH issue
• [x] double check the metrics aren't being reported somewhere by the state
• [x] remove carried over values
• [x] null out source notes
• [x] null out WS2 values
• [x] update public note

no chart annotation added because we don't have a chart with this metric

Values removed: Changes.txt

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions!

This issue has been closed because it was stale for 15 days, and there was no further activity on it for 10 days. You can feel free to re-open it if the issue is important, and label it as "not stale."

We can't backfill this because we do not know what data AK provided at the time, and the source we have for it is constantly backfilled by the state.

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions!

This issue has been closed because it was stale for 15 days, and there was no further activity on it for 10 days. You can feel free to re-open it if the issue is important, and label it as "not stale."

We can't backfill this because we do not know what data AK provided at the time, and the source we have for it is constantly backfilled by the state.

Changes (2).txt

Changes (2).txt

BEFORE:

AFTER:

BEFORE:

AFTER:

All metrics were patched except for recoveries which did not appear on the dashboard.

AK - Analysis Positives 20201116.pdf

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions!

BEFORE:

AFTER:

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions!

This issue has been closed because it was stale for 15 days, and there was no further activity on it for 10 days. You can feel free to re-open it if the issue is important, and label it as "not stale."

BEFORE:

AFTER:

I believe this is already referenced in issue #640 , as all the non-resident cases up to 16 JUL were added in bulk to that date. The necessary data to backfill the nonresident cases into the total cases is available in this CSV: https://opendata.arcgis.com/datasets/f34c6b1e58f34939bb6d2d721eb7a1e7_0.csv

In case folks are interested in viewing the data directly, here's the source: https://coronavirus-response-alaska-dhss.hub.arcgis.com/datasets/covid-cases-out-of-state

The CSV linked below updates daily with the non-resident cases: https://opendata.arcgis.com/datasets/f34c6b1e58f34939bb6d2d721eb7a1e7_0.csv

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions!

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions!

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions!

This issue has been closed because it was stale for 15 days, and there was no further activity on it for 10 days. You can feel free to re-open it if the issue is important, and label it as "not stale."

AK confirmed to report only lab-confirmed cases. WS2 pop-ups was also modified to account for this.

States daily corrected, values in C also added to V.

Before: After:

Hey @muamichali, would this update be for July 6? I checked out two of the AK press releases below. This is what I think should be the updated for July 6:

• Total Tests (PCR): 128330
• Positive Cases: 1166
• Negative: 128330 - 1166 = 127164
• Currently Hospitalized: 25
• Currently on Ventilator: 2 Recovered: 552
• Deaths: 16

CASE COUNT SUMMARY, Sunday, July 5, 2020 DHSS today announced 32 people with COVID-19 in Alaska. 27 are residents in four communities: Anchorage (22), Fairbanks (2), Seward (2) and Palmer (1). The total number of Alaska cases is now 1,138.

Source

CASE COUNT SUMMARY, Monday, July 6, 2020 DHSS today announced 30 people with COVID-19 in Alaska. 28 are residents in seven communities: Anchorage (19), Fairbanks (3), North Pole (2), Kenai (1), Seward (1), Sterling (1) and Wasilla (1). The total number of Alaska cases is now 1,166.

Source

Per Slack thread, we updated July 5 already. Closing this issue.

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions!

Hi @scarson, Thanks for reporting this issue (and for reporting similar issues with CA, #431 - #433, which I responded to a few days ago). We've been discussing policy on day lags since then and decided that in order to increase the meaningfulness of the historical time series, we will be updating to correct them. I've just checked and AK is on our running list to update with high priority.

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions!

This issue has been closed because it was stale for 15 days, and there was no further activity on it for 10 days. You can feel free to re-open it if the issue is important, and label it as "not stale."

Hi @thaddeuspompidou

We will update the data on our end from nothing to zero so it will be visible in the API. The change should be reflected tomorrow afternoon.

Before

After

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions!

This issue has been closed because it was stale for 15 days, and there was no further activity on it for 10 days. You can feel free to re-open it if the issue is important, and label it as "not stale."

Uploading a spreadsheet of all decreases (more than documented previously), current as of today: covidtracking_problemdates.xlsx

States affected: AK, AL, AZ, CO, DC, DE, FL, HI, IA, KS, MA, MD, MI, NJ, NM, NV, NY, OH, OK, PR, RI, SC, WI

This is my R code to calculate new cases and pull records that decreased from the prior day (any variable) AND the prior day's row for comparison:

library(tidyverse)
covidtracking %>% 
    arrange(state, date) %>% 
    group_by(state) %>% 
    mutate_at(vars(c("positive", "death", "total")), 
              list(new = ~ coalesce(. - lag(.), .))) %>%
    filter_at(vars(ends_with("new")), any_vars(. < 0 | lead(.) < 0)) %>% 
    ungroup()

I wonder if the problem is an error in the data source in which corrections for prior day results are included as adjustments on the day the error was discovered. This is common in the banking world because of the value of keeping past transactions immutable. It's poor practice for scientific data, however, because the test counts on a given day matter.

If the problem is deferred adjustment, the idea solution is to inform the data sources and ask for better quality data. Short of that, an corrective approach is to reverse the error to the best extent that the data allows: Where a daily result is negative, set that day to zero, and decrease the count of the previous day by the corresponding amount.

Such a correction would not be perfect since (a) you don't know for sure whether the error was from the previous day versus earlier and (b) it doesn't correct any of the cases where adjustments didn't cause negative result. Still, it leads to better data quality than making no correction and avoids the confusion of negative daily counts.

Hello, and thank you for helping us clean our data. Please see the following:

New York:

• [ ] 3/7 to 3/8 the total changed due to pending tests no longer being reported.
• [ ] 3/10 to 3/11 should be correct

Oklahoma

• [ ] 3/20 to 3/21 the variance in totals is tied to the unreliable Pending category. It may be that the data point was phased out and our data was affected by this transition;

Ohio

• [ ] 3/16 to 3/17 variation in data is due to Pending data no longer being published.

New Jersey

• [ ] 3/16 is infact incorrect:
• [ ] corrected

Hawaii

• [ ] Pending for 3/19 decrease per the state

Michigan stopped reporting pending data as of 3/17

Kansas stopped reporting pending data as of 3/11

Iowa stopped reporting pending data as of 3/14 Deleware stopped reporting pending data as of 3/17 DC has fluctuating pending data

Thank you for these clarifications, @careeningspace, and for working on providing these data so accessibly! In terms of cleaning up these records for use:

1. Has the NJ correction been applied to the live data?
2. Given the inconsistencies with pending data, do you foresee any problems with subtracting pending cases from the totals?

The NJ correction should be in the live feed. Going forward, our API will no longer be focusing on including Pending in our "Total". You can find more detail on our API Page

• [ ] totalTestResults - Calculated value (positive + negative) of total test results.
• [ ] total - DEPRECATED Will be removed in the future. (positive + negative + pending). Pending has been an unstable value and should not count in any totals.

As for subtracting historical "Pending" data - if you want a clean Total, you can sum Positive and Negative.

Great, thanks. That fixes problems in many states and leaves only AK, DC, HI, ID, KY, MI, NV, and SC with negative "increases": covidtracking_problemdates.xlsx

covidtracking %>% arrange(state, date) %>% group_by(state) %>% filter_at(vars(ends_with("Increase")), any_vars(. < 0 | lead(.) < 0)) %>% ungroup()

-[ ] Alaska has a period of data flux that needs more research 3/17 - 3/19: Data Log:

Daily Report:

State Data from 3/17 14:09 ET:

State Data from 3/17 18:00 ET:

State Data from 3/18:

Updated Daily after correction:

District of Columbia 3/10 - 3/11

• [ ] We do not have screen grabs from this time period
• [ ] It looks like DC changed how they were reporting data. I am going to make both days match

DC Before update:

DC after update:

• [ ] ID has an issue with a change in data from 3/18 to 3/19

• [ ] Screen cap of State Data from 3/18 14:04:

• [ ] Screencap of State Data from 3/19 14:04:

• [ ] The positives increase, while the total tests reported did not. Our methodology is to leave the negatives unchanged in this case. Fixed data below:

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions!

This issue has been closed because it was stale for 15 days, and there was no further activity on it for 10 days. You can feel free to re-open it if the issue is important, and label it as "not stale."