Best Practice Guide for Canadian Data Centres – Appendices

Appendix I

Bibliography

AFCOM, 2018, State of the Data Centre Survey.

Airatwork, 2024. https://airatwork.com/wp-content/uploads/The-Green-Grid-White-Paper-35-WUE-Usage-Guidelines.pdf.

Amazon Cloud Services, 2024. https://aws.amazon.com/what-is/virtualization/#:~:text=Virtualization%20is%20technology%20that%20you,on%20a%20single%20physical%20machine.

ASHRAE Standard Project Committee, 2020. “Energy Standard for Data Standards”. ASHRAE Standard: https://www.ashrae.org/file%20library/technical%20resources/standards%20and%20guidelines/standards%20addenda/90_4_2019_a_20201030.pdf.

Best Canada Energy, 2024. https://bestcanada.energy.

Blackburn, Mark, 2010, “WP# 34 – THE GREEN GRID DATA CENTRE COMPUTE EFFICIENCY METRIC: DCCE”: https://www.thegreengrid.org/en/resources/library-and-tools/240-WP.

Canadian Standards Association C510 (under development) Energy Efficiency Performance (Benchmark Energy Factor) of Data Communication Centres.

Cisco, 2020, Annual Internet Report: 2018-2023.

Consortium for Energy Efficiency, 2007, Data Centres & Servers Initiative Description.

Cushman & Wakefield, Data Centre Reports: Americas Second-Half 2020.

Cushman & Wakefield, Global Data Centre Market Report, 2020.

Data Centre Frontier, “Soaring Bitcoin Price Boosts Fortunes of Cryptocurrency Mining Firms”, January 2021: https://www.datacenterfrontier.com/cloud/article/11428467/soaring-bitcoin-price-boosts-fortunes-of-cryptocurrency-mining-firms/.

Dayarathna and Wen, 2016, Data Centre Energy Consumption Modeling: A Survey. IEEE Communications Surveys & Tutorials.

ENERGY STAR® Portfolio Manager® Glossary: https://portfoliomanager.energystar.gov/pm/glossary.

ENERGY STAR®, 2018, Portfolio Manager® Technical Reference: Data Centre Estimates in the United States and Canada.

Engineering News Record, “Bitcoin Mining Helps Boost a Growing Data Centre Market”, November 2020: https://www.enr.com/articles/50762-bitcoin-mining-helps-boost-a-growing-data-centre-market.

European Code of Conduct for Energy Efficiency in Data Centres. https://joint-research-centre.ec.europa.eu/scientific-activities-z/energy-efficiency/energy-efficiency-products/code-conduct-ict/european-code-conduct-energy-efficiency-data-centres_en.

FS USA, 2024. https://www.fs.com/technical_documents.html.

Green Horizon, 2024. https://greenhorizon.no/glossary/cooling-efficiency-ratio-cer/#:~:text=Cooling%20Efficiency%20Ratio%20(CER)%20is,consumption%20of%20the%20cooling%20system.

Hydro-Québec, 2020, “Blockchain Industry in Quebec”: https://www.hydroquebec.com/blockchain/.

Hydro-Québec, 2020, “État d’Avancement 2020 du Plan d’Approvisionnement 2020-2029”.

Independent Electric System Operator, 2019, Achievable Potential Study.

International Energy Agency (IEA). 2024 https://www.iea.org/energy-system/buildings/data-centres-and-data-transmission-networks.

JLL Research Report: Data Centre Outlook: H1 2018.

Kosik, Bill, 2020, “What ASHRAE 90.4 does for data centre energy efficiency”: https://www.csemag.com/articles/what-ashrae-90-4-does-for-data-centre-energy-efficiency/.

Meadows, Dave., “Regulations Determining Computer Room Cooling Selection: Precision vs Comfort Cooling”. Stulz USA 2024: https://info.stulz-usa.com/white-paper-regulations-computer-room-precision-cooling.

MSP Corporation, 2024. Best Practice for Data Protection and Compliance in Canada. https://www.mspcorp.ca/best-practices-for-data-protection-and-compliance-in-canada/.

Navius Research, 2024. https://www.naviusresearch.com/canada_energy_dashboard/.

Natural Resources Canada, 2015, 2021, 2023. Canadian Market Analysis for Servers and Data Centres.

New York State Research and Development Authority, 2015, New York State Data Centre Market Characterization.

Rack Solutions. https://www.racksolutions.com/news/tag/products/.

Shehabi et al., 2016, United States Data Centre Energy Usage Report.

Tchudi et al., 2003, High Performance Data Centres – A Research Roadmap.

Tschudi et al., 2010, “ERE: A Metric for Measuring the Benefit of Reuse Energy from a Data Centre”, The Green Grid: https://www.thegreengrid.org/en/resources/library-and-tools/242-ERE%3A-A-Metric-for-Measuring-the-Benefit-of-Reuse-Energy-From-a-Data-Center. (Must sign in to host website to download document)

US DOE Lawrence Berkeley National Laboratory, 2024. https://datacenters.lbl.gov/resources/ere-metric-measuring-benefit-reuse.

US EPA, 2007, Report to Congress on Server and Data Centre Energy Efficiency.

US Green Building Council, 2024. https://www.usgbc.org/leed.

Velimirovic, Andreja, 2021, “Data Centre Tiers Explained”: https://phoenixnap.com/blog/data-centre-tiers-classification.

Appendix II

Canadian Data Centre Cooling and Power Density Preliminary Benchmarks

In 2021, the consensus among published sources and experts surveyed by the NRCan market assessment study indicated that IT equipment typically accounts for between 65% and 85% of total data centre electricity consumption, and cooling equipment accounts for between 15% and 25% of total data centre electricity consumption. The 2021 NRCan study also found that most Canadian data centres were air-cooled using either CRAC/CRAH perimeter cooling or close-coupled distributed cooling. The table below provides a summary of cooling system characteristics by data centre power density (PD) from 2021. This preliminary PD benchmark can be used by facilities to compare their own PD relative to other data centres operating in Canada.

Table 2: Cooling System Characteristics by Power Density (2021)
Power Density kW/m2 Mechanical System Characteristics
Average < 2.15 CRAC/CRAH
High 2.15 – 5.4 Close-coupled distributed cooling
Extreme > 5.4 Close-coupled distributed cooling

Appendix III

EU Energy Efficiency Directive and Requirements for Data Centres

Data centre operators located in the EU, with an installed IT power demand of at least 500 kW must submit report to the European database by 15 September 2024. Reports will be submitted directly to the upcoming European database or to their national platform (if their country requires it).

EED Timeline for Data Centres in the EU:
  • May 2024 – Publication of the delegated regulation. The delegated regulation sets up the reporting scheme, and lists the data points to be collected and associated KPIs. Moreover, the delegated regulation legally sets up the European database which will collect the information, and publish some of it at two levels of aggregation: EU level and country levels. The delegated regulation entered into force 20 days after its publication (6 June 2024).
  • September 2024 – Reporting. By September 2024, then by May 2025 and every year thereafter, data centre operators will have to report to the European database the information and KPIs regarding the data centre they operate.
  • Upcoming:
    • Transposition of the EED into national law. The EED must be transposed by Member States into their national legal systems, through the legal instruments of their choice. Upon transposing the EED, Member States may also change certain aspects of the reporting scheme, such as adding new data points, widening the scope of reporting entities, or setting up their own national reporting platform for instance.
    • Submitted data will be published in an aggregated manner at EU and Member States levels, and will be assessed in 2025. Following the assessment, the European Commission may propose further measures to improve the sustainable development of the industry, such as minimum performance standards, or a labelling scheme.
Implementation Support for Data Centres:

The European Commission published Task Reports (A,B,C) as part of the regulation framework to support implementation:

  • Task A report – options for a reporting scheme for data centres (October 2023). The report provides an overview of data centres and outlines options for reporting requirements. The goal of this report is to provide a baseline understanding of current situation of data centres energy consumption.
  • Task B report – Labelling and minimum performance standards schemes for data centres (December 2023). This report focuses on “development of energy efficiency measures” and best practices. The report identifies and evaluates protentional measures and technologies that can improve energy efficiency in data centres including recommendations for energy-saving technologies, design improvements, operational practices that can help reduce the energy footprint of data centres.
  • Task C report – EU repository for the reporting obligation of data centres (December 2023). This report includes the “assessment and implementation strategies” for the proposed measures from TASK B report. It includes detailed guidelines and frameworks for implementing the reporting requirements (i.e., outline/template for input data on the platform that data centres will use).
Other resources:
  • Data centre operators can implement IT efficiency tools like DCIM (Data Centre Infrastructure Monitoring) that monitor and optimize the performance of their IT equipment. DCIM can aggregate and report on PUE, total energy consumption with breakdowns by subsystems and even carbon emissions. Operators will be able to set baselines and start accumulating reports and will be able to use the reports to visualize inefficiencies, unnecessary power consumption and improve overall system efficiency. See Energy Efficiency Directive (europa.eu).
EED for Mixed Use Buildings:

EED reporting also applies to mixed-used buildings – reporting requirements applies only to data centre portion of the building. They are expected to follow reporting requirements by doing the following:

  • Separate Metering and Allocation: Mixed-use buildings should ideally have separate metering for different functions or sectors within the building (e.g., residential, commercial, and data centre areas). Data centres, which are typically high energy users, should have their energy consumption tracked separately from other building uses.
  • Integrated Reporting Systems: To facilitate compliance, many buildings adopt integrated energy management systems that allow for detailed and accurate reporting of energy consumption for different building functions (i.e., DCIM tool)
Exemptions:

KPIs on energy and sustainability:

  • For the first reporting period, if a data centre operator cannot monitor and gather one or more of the key performance indicators set out in Appendix II , points 1(d), 1(e), 1(h)-(l), and 1(o)-(r), for technical reasons, the data centre operator may omit this information, and provide an explanation for the reasons for this omission.

KPIs on ICT capacity equipment:

  • ICT capacity for servers/storage equipment shall be reported, as a minimum, for all new services/devices installed in the reporting data centre after the entry into force of this Delegated Regulation.
  • §2: Similarly, as the first year, only equipment installed after the entry into force of the delegated regulation (Q2 2024, tbc) must be reported. Therefore, only the second half of the year 2024 is covered.
  • ART. 3.2 DA: For the first two reporting periods, if a colocation data centre operator cannot monitor and gather the necessary data to sufficiently calculate the key performance indicators referred to in points 2(a) and 2(b) of Appendix II , it shall estimate and indicate the percentage of the data centre computer room floor area that the information communicated to the European database covers.
Colocation Data Centres:
  • Reporting on ICT capacity and data traffic is especially difficult for colocation data centre operators, as they do not possess this information. For both of these categories, the Delegated Regulation provides that colocation operators may set up an anonymous internal reporting mechanism, to gather data from their customers.
References:
  1. The EU Energy Efficiency Directive and its impact on CIOs, data centre owners and operators
  2. Energy Efficiency Directive
  3. Data centres in Europe – reporting scheme
  4. Commission adopts EU-wide scheme for rating sustainability of data centres

Appendix IV

Data Centre Definition

The table below provides definitions of the term “data centre” from a range of authorities and research institutions. There is a general consensus in the literature regarding the purpose of data centres and related IT equipment. Additionally, several sources published since 2015 do not consider as data centres spaces that include IT equipment but were not designed or equipped primarily for data processing, storage, and communication, such as most server closets and server rooms within larger space types.

  Definition
US EPA, Report to Congress on Server and Data Centre Energy Efficiency, 2007 “A data centre contains primarily electronic equipment used for data processing (servers), data storage (storage equipment), and communications (network equipment). Collectively, this equipment processes, stores, and transmits digital information and is known as ?information technology' (IT) equipment. Data centres also usually contain specialized power conversion and backup equipment to maintain reliable, high-quality power, as well as environmental control equipment to maintain the proper temperature and humidity for the IT equipment.”
Telecommunications Industry Association, Telecommunications Infrastructure Standard for Data Centres, 2005. “Data centre: a building or portion of a building whose primary function is to house a computer room and its support areas.”
Lawrence Berkeley National Laboratory, High Performance Data Centres – A Research Roadmap, 2003 “…we generally use the term data centre to be a facility that contains concentrated equipment to perform one or more of the following functions: store, manage, process and exchange digital data and information. We do not consider spaces that primarily house office computers, including individual workstations, servers associated with workstations, or small server rooms, to be data centres.”
European Commission, Code of Conduct on Data Centres, Version 0.7, 2008 “The term ‘data centres’ includes all buildings, facilities, offices and rooms which contain enterprise servers, server communication equipment, cooling equipment and power equipment, and provide some form of data service (e.g., large-scale mission-critical facilities all the way down to small server rooms located in office buildings).”
ENERGY STAR® Portfolio Manager® Glossary

“Data Centre refers to buildings specifically designed and equipped to meet the needs of high density computing equipment, such as server racks, used for data storage and processing. Typically, these facilities require dedicated uninterruptible power supplies and cooling systems. Data centre functions may include traditional enterprise services, on-demand enterprise services, high performance computing, Internet facilities, and/or hosting facilities.

Often Data Centres are free standing, mission critical computing centres. When a data centre is located within a larger building, it will usually have its own power and cooling systems, and require a constant power load of 75 kW or more. Data Centre is intended for sophisticated computing and server functions; it should not be used to represent a server closet or computer training area.”

Canadian Standards Association, Standard C510 (under development) Energy Efficiency Performance of Data Communication Centres, 2020 “Data centres that are included within the scope of this Standard include data centres with a minimum IT load of 100 kW that are typically used in enterprises, government, institutional (hospital and university), and other facilities where the organization has influence over the equipment and a vested interest in the energy consumption of the data centre. This may include third-party managed data centres when the above conditions are met.”
Back to navigation menu