Frequently Asked Questions about Public ResStock Datasets

General

Data Viewer

Calibration and validation

Model input files

I have a question not answered here.

General

What buildings are represented by each dataset?

The residential (ResStock) dataset represents dwelling units in the contiguous United States, including single-family, multi-family (including high rise multi-family), and mobile homes. It does not include dormitories, prisons, assisted care facilities, and other congregate housing situations.

The commercial (ComStock) dataset represents 13 of the most common commercial building types – small office, medium office, large office, retail, strip mall, warehouse, primary school, full-service restaurant, quick-service restaurant, small hotel, large hotel, hospital, and outpatient – which comprise about 70% of the commercial sector floor area in the United States according to CBECS.

What year does the baseline building stock represent?

The building stock represents, as closely as possible, the U.S. building stock as it was in 2018. The building stock representation is the same for the two weather years of end use load profile results (2018 and TMY3).

Should I use aggregate timeseries data or individual building profiles?

It depends on your application. Many applications just need an aggregate load shape. If analyzing scenarios that require realistic spikiness of individual dwelling unit or building loads, such as behind-the-meter solar plus storage, rate design involving real-time pricing or demand charges, or distribution system impacts, then we recommend using individual building profiles. These recommendations will be discussed in more detail in a forthcoming Applications and Opportunities report.

Are descriptions available for the filters and end-use categories?

Descriptions of each of the building characteristics filters and the end-use categories can be found in the data_dictionary.tsv file (example). Descriptions of the values used in those filters can be found in the enumeration_dictionary.tsv (example). Both files can be opened with Excel or a text editor.

What does "water systems" mean?

Water system energy consumption includes all building energy related to to residential water heating and commercial service water heating and pumping.

Does the dataset include data on XYZ end-use category or device?

The list of included end-use categories can be found under the fields labeled "out.electricity", "out.natural_gas", etc. in the data_dictionary.tsv file (example).

Is there a legend or lookup for the geographic codes (g0100010 for county, g01000100 for PUMA, etc.)?

In each of the published datasets there is a spatial lookup table: spatial_tract_lookup_table.csv (example). County and PUMA codes can be looked up using the "nhgis_county_gisjoin" and "nhgis_puma_gisjoin" columns, respectively. If you want to find the pre-aggregated timeseries file for a county or PUMA, you can use this lookup to find the code for the county of interest. To find the 5-digit PUMA code based on a city or place name, use this U.S. Census file.

Are there load profiles available for the 16 California Climate Zones?

Aggregating by California climate zone is available for residential building profiles but not commercial building profiles.

To achieve this aggregation for the residential load profiles, use the resstock.nrel.gov website and select the dataset and region of interest (Example: the ResStock National Load Profiles by State 2018 dataset and the state of California.) At the bottom click the “Explore Timeseries” button. At the left side, halfway down, click the button “+ Add Filters”. In the “Filters” column, find and select the “Cec climate zone” filter. The options available are for CEC Climate Zones 1-16. Do not use the “None” option, as the option is for locations outside the state of California.

How can I see the building characteristics associated with an aggregate load profile?

There are two ways to access the building characteristics data associated with an aggregate load profile:

  1. Building Characteristics data viewer (example) - Like the energy data viewer, you can apply filters to focus on the subset of the building stock that you are interested in.
  2. Metadata.tsv files - The raw building characteristics data can be found in the metadata.tsv file corresponding to each dataset (ResStock example) (ComStock example). The metadata.tsv files are in tab-separated value format and can be opened in Excel or with scripting languages. The files can be filtered down to the same subset of dwelling units or buildings in whatever timeseries you are using. You can use the various characteristic string fields (e.g., “HVAC Heating Efficiency”) to understand the distribution of characteristic values across that subset of dwelling units or buildings. For ResStock, each row has an equal weighting (found in the “Sample Weight” field). For ComStock, each row can be weighted with the "Weight" field (all buildings of a given type have the same weight).

How can I see the building characteristics associated with an individual building (or dwelling unit) load profile?

The filename of the individual building (or dwelling unit) load profiles .parquet files contains the building ID. Each of these building IDs corresponds to a row in the dataset's metadata, which is available in either .parquet or .tsv format (tab-separated value format that can be opened in Excel) (ResStock example) (ComStock example).

What are the units on downloaded data?

All downloaded energy data is in kWh, including all electricity, natural gas, propane, and fuel oil end uses, as documented in the data_dictionary.tsv files (example).

What is the timezone of timestamps?

The timestamps of all load profiles have been converted to Eastern Standard Time, to prevent issues when aggregating across time zones.

Do the aggregates have the sample weighting factors applied?

Yes, the aggregates represent the "floor_area_represented"/"units_represented".

What software can I use to open the individual building timeseries .parquet files?

Parquet files can be read using programming languages such as Python, using the pyarrow package. For other options, see https://arrow.apache.org/docs/index.html. There are a few third-party graphical tools for viewing parquet files, but we have not tested them and the third-party support is limited.

Is there a plan to develop an API to access data without downloading locally?

There are no plans for an API. However, we are currently developing documentation that will explain how to link one’s own Amazon Web Services account to this data, so the data can be queried by analytic tools like Athena. We will also be providing example SQL queries to help facilitate analyses.

Data Viewer

Why is the time series data sometimes slow to load after I click the update button?

We query several terabytes (TB) of data in real time to produce the time series graphs you see on the webpage. Running a query for California, Texas, New York, or Illinois takes around a minute, while running a query for a state like Colorado or Massachusetts takes about 10-20 seconds. However - if the graphs have previously been generated we have the data cached and can typically load the data in a few second. That's why sometimes loading new graphs is faster than other times.

Why can’t I click on “Explore Timeseries”?

The “Explore Timeseries” option is available once a specific geography (state or PUMA region) is selected.

How do I see a profile for just one, or just a few, end uses?

Clicking on the end uses in the legend will toggle their inclusion in the visualization.

How can I access a specific day of timeseries data?

In the “Explore Timeseries” mode, use the Month Constraints sliders to select the month of the day you are interested in. Then choose “Export csv” and “15 minute resolution”. The resulting csv file will have 15 minute end use load profiles that are not aggregated over time.

Does the timestamp represent the beginning, middle, or end of each 15-minute interval?

The timestamp indicates the end of each 15-minute interval. So "12:15" represents the energy use between 12:00 and 12:15.

What is being summed or averaged over?

The 'sum' aggregation is the total energy consumption for all buildings that meet the filter criteria across all the occurrences of the given time step within the selected month(s). For example, in a day timeseries range for the month of July, the 7-7:15 AM hour time step shows the sum of all energy consumption between 7-7:15 AM in July, from buildings that meet the filter criteria.

The 'average' aggregation is the total energy consumption for all buildings that meet the filter criteria, averaged across all the occurrences of the given time step within the selected month(s). Note that this is not currently working correctly for some datasets.

Can I aggregate over multiple locations?

The viewer allows aggregations of up to 5 locations (states or PUMAs, depending on the dataset). When viewing a single location, choose the “+ More Locations” option, add up to five additional locations, and choose “Update Search”.

Sums of more than six locations can be created manually by downloading sums of up to six locations and summing further on your local computer.

TMY3 weather is not aligned between locations. If your application requires aligned weather, either use the 2018 dataset, or filter by weather station and sum only within a single weather station’s PUMAs.

How should I interpret graphs that include PV?

Downloading a csv of the relevant data is the best approach. The data visualizations in the web viewer that include PV have some UI complexities that are still being worked out. We are also aware that the plot axes cut off negative values.

How are the peak day and min peak day identified?

The peak day is the day with the highest single-hour (peak) energy consumption within the selected months.

The min peak day is the day with the lowest single-hour peak energy consumption within the selected months.

How do I see which day is the peak day?

This is not currently available in the web interface, but you can use the interface to download the full year of 15-min data and see which day is the peak day.

How can I access energy use intensity (per square foot) data?

Pre-aggregated files

For commercial buildings, the pre-aggregated timeseries files include a floor area column, so it is straightforward to divide energy use by the floor area to get intensity. Floor area is not currently included in the residential aggregates, but the floor area can be calculated from the metadata.tsv file (example), by adding up the values in the "floor_area_conditioned_ft_2" column after filtering down to the building type and geographic region corresponding to the pre-aggregated file.

Data viewer

In the data viewer, the bar graphs can show energy use intensity by selecting "energy_consumption_intensity" from the Output drop down menu. Timeseries data for energy use intensity are not directly available, but you can use the Building Characteristics viewer to download floor area values for a filtered subset of buildings and use that to convert timeseries energy use to timeseries energy use intensity.

What is the number hovering over the timeseries y axis when I hold my cursor over a specific end use?

This is the total energy consumption by that end use within the selected months.

Can I get the raw data shown by the Data Viewer and Building Characteristics?

Yes! Please visit the End Use Load Profiles for the U.S. Building Stock project website for instructions.

Calibration and Validation

Did the calibration include natural gas or other fuels?

While the validation effort was largely focused on electricity, we did make some comparisons to annual and monthly EIA survey data for natural gas. These comparisons, which we used to inform the model improvements made during calibration, will be published in a Methodology and Results report coming this winter. We did not do any comparisons for propane, fuel oil, or other fuels, although these fuels are included in the models.

Have you compared the dataset to XYZ?

All comparisons we completed as part of the calibration and validation effort will be published in a Methodology and Results report coming this winter. In general, the comparisons are against anonymous hourly utility meter data, EIA monthly/annual data, and various end-use metered datasets.

Model input files

Are the EnergyPlus model input files (.idf) available?

Not directly. We made OpenStudio model input files (.osm) available in the dataset (example), which generate the EnergyPlus model input files. The commercial building models are not yet uploaded, but will be soon. The residential models require external schedule .csv files that will be uploaded soon.

Your browser is out-of-date!

Update your browser to view this website correctly. Update my browser now

×