Big Data Management in Smart Grids: Technologies and Challenges

Smart grids are re-engineering the electricity transmission and distribution system throughout the world. It is an amalgam of increased digital information with the electrical power grids. Managing the data generated from the grid efficiently is the key to successful knowledge extraction from the sm...

Full description

Bibliographic Details
Main Authors: Ameema Zainab, Ali Ghrayeb, Dabeeruddin Syed, Haitham Abu-Rub, Shady S. Refaat, Othmane Bouhali
Format: Article
Language:English
Published: IEEE 2021-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9431185/
id doaj-2523c6cefb8248c2b852fab317a8fa3d
record_format Article
spelling doaj-2523c6cefb8248c2b852fab317a8fa3d2021-06-02T23:17:26ZengIEEEIEEE Access2169-35362021-01-019730467305910.1109/ACCESS.2021.30804339431185Big Data Management in Smart Grids: Technologies and ChallengesAmeema Zainab0https://orcid.org/0000-0002-3754-4162Ali Ghrayeb1https://orcid.org/0000-0002-6808-5886Dabeeruddin Syed2https://orcid.org/0000-0002-9431-4849Haitham Abu-Rub3https://orcid.org/0000-0001-8687-3942Shady S. Refaat4https://orcid.org/0000-0001-9392-6141Othmane Bouhali5Department of Electrical and Computer Engineering, Texas A&M University, College Station, TX, USADepartment of Electrical and Computer Engineering, Texas A&M University at Qatar, Doha, QatarDepartment of Electrical and Computer Engineering, Texas A&M University, College Station, TX, USADepartment of Electrical and Computer Engineering, Texas A&M University at Qatar, Doha, QatarDepartment of Electrical and Computer Engineering, Texas A&M University at Qatar, Doha, QatarDepartment of Electrical and Computer Engineering, Texas A&M University at Qatar, Doha, QatarSmart grids are re-engineering the electricity transmission and distribution system throughout the world. It is an amalgam of increased digital information with the electrical power grids. Managing the data generated from the grid efficiently is the key to successful knowledge extraction from the smart grid big data. Most of the scientific advancements are becoming data-driven and becoming an interesting area of research for data scientists. It is challenging the world computationally enough to develop new storage methods and data processing technologies. Managing big data involves data cleaning, integration of varied data sources, and decision-making applications. This paper focuses on the study of big data management and proposes a management process to help manage the data in the grid. Data management tools and techniques have been leveraged in understanding the sources and data types in the grid. The paper emphasizes the limitations of the existing solutions inclined towards applications of the smart grid big data.https://ieeexplore.ieee.org/document/9431185/Apache sparkbig datadata miningHadoopindexingmanagement process
collection DOAJ
language English
format Article
sources DOAJ
author Ameema Zainab
Ali Ghrayeb
Dabeeruddin Syed
Haitham Abu-Rub
Shady S. Refaat
Othmane Bouhali
spellingShingle Ameema Zainab
Ali Ghrayeb
Dabeeruddin Syed
Haitham Abu-Rub
Shady S. Refaat
Othmane Bouhali
Big Data Management in Smart Grids: Technologies and Challenges
IEEE Access
Apache spark
big data
data mining
Hadoop
indexing
management process
author_facet Ameema Zainab
Ali Ghrayeb
Dabeeruddin Syed
Haitham Abu-Rub
Shady S. Refaat
Othmane Bouhali
author_sort Ameema Zainab
title Big Data Management in Smart Grids: Technologies and Challenges
title_short Big Data Management in Smart Grids: Technologies and Challenges
title_full Big Data Management in Smart Grids: Technologies and Challenges
title_fullStr Big Data Management in Smart Grids: Technologies and Challenges
title_full_unstemmed Big Data Management in Smart Grids: Technologies and Challenges
title_sort big data management in smart grids: technologies and challenges
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2021-01-01
description Smart grids are re-engineering the electricity transmission and distribution system throughout the world. It is an amalgam of increased digital information with the electrical power grids. Managing the data generated from the grid efficiently is the key to successful knowledge extraction from the smart grid big data. Most of the scientific advancements are becoming data-driven and becoming an interesting area of research for data scientists. It is challenging the world computationally enough to develop new storage methods and data processing technologies. Managing big data involves data cleaning, integration of varied data sources, and decision-making applications. This paper focuses on the study of big data management and proposes a management process to help manage the data in the grid. Data management tools and techniques have been leveraged in understanding the sources and data types in the grid. The paper emphasizes the limitations of the existing solutions inclined towards applications of the smart grid big data.
topic Apache spark
big data
data mining
Hadoop
indexing
management process
url https://ieeexplore.ieee.org/document/9431185/
work_keys_str_mv AT ameemazainab bigdatamanagementinsmartgridstechnologiesandchallenges
AT alighrayeb bigdatamanagementinsmartgridstechnologiesandchallenges
AT dabeeruddinsyed bigdatamanagementinsmartgridstechnologiesandchallenges
AT haithamaburub bigdatamanagementinsmartgridstechnologiesandchallenges
AT shadysrefaat bigdatamanagementinsmartgridstechnologiesandchallenges
AT othmanebouhali bigdatamanagementinsmartgridstechnologiesandchallenges
_version_ 1721400058792902656