Skip to content

Commit 367d667

Browse files
committed
docs: update wiki
1 parent c8281b9 commit 367d667

File tree

2 files changed

+42
-12
lines changed

2 files changed

+42
-12
lines changed

docs/index.md

Lines changed: 27 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -1,20 +1,39 @@
1-
# DiTEC-WDN - The Gigantic Dataset
1+
# DiTEC-WDN Dataset (DWD)
22

3-
This work includes a collection of synthetic scenarios devised from 36 **Water Distribution Networks (WDNs)**.
3+
DWD is a collection of synthetic, simulated and steady-state scenarios derived from 36 **Water Distribution Networks (WDNs)**.
44

5-
For the sake of clarity, it would be better to get into familiarized concepts:
5+
Each network has 1,000 distinct hydraulic scenarios generated by an open-sourced simulation toolkit EPANET.
6+
7+
We then describe surronding concepts as follows:
68

79
* **Scenario** denotes as a sequence of snapshots.
810

9-
* **Snapshot** represents a measured steady-state of a particular WDN and is often modelled as an undirect graph.
11+
* **Snapshot** represents as a network's state often modelled as a graph at a particular timestep.
12+
13+
* **Nodes** models a reservoir, junction, or tank in the snapshot graph. Each type has same properties and unique ones.
14+
15+
* **Edges** refers pipe, pump, or valve in the snapshot graph. Each type has same properties and unique ones.
16+
17+
* **Input parameters** involves in simulation input parameters, such as demands, pipe diameter, and so on.
18+
19+
* **Output parameters** includes simulation measurements (e.g., pressure, flow rate, head, ...)
20+
21+
Both parameters are described as nodal/edge features in the snapshot graph. Their values are diverse but temporally correlated with those of other snapshots in the **same** scenario.
22+
However, in DWD, any two scenarios are independent and unrelated since they are created from different configurations (despite the same original network).
23+
24+
DWD is designed to:
25+
26+
* Promote open scientific research in the water domain.
27+
28+
* Eliminate risks of exposing sensitive data, privacy issues, or safety concerns.
1029

11-
* **Input parameters** includes simulation inputs, such as demands, pipe diameter, and so on.
30+
* Provide a benchmark for data-driven machine learning methods and large-scale scenario analysis.
1231

13-
* **Output parameters** includes simulation outcomes which researchers are interested in (e.g., pressure, flow rate, head, ...)
32+
This wiki details the process of creating DWD, including parameter optimization, simulation, and encapsulation.
1433

15-
Both parameters are described as nodal/edge features in the snapshot graph. Their values are diverse but temporal correlated with those of other snapshots in the **same** scenario.
16-
However, in DiTEC-WDN, two scenarios are considered completely different WDNs despite their origin being the same network.
34+
It also explains how to use DWD’s data interface, GiDA.
1735

36+
With just two inputs, an .INP file and a YAML configuration, you can generate diverse scenarios and apply this to your own private WDN.
1837

1938
# Acknowledgement
2039
This work is funded by the project DiTEC: Digital Twin for Evolutionary Changes in Water Networks (NWO 19454).

docs/installation.md

Lines changed: 15 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -1,8 +1,13 @@
1-
# Manually download the data
2-
TODO: Update later
1+
# Download Data
2+
**DWD** are shipped in two formats: `.parquet` and `.zarr`. Both has their own advantages and drawbacks:
3+
4+
* `.parquet` files are fully supported by Hugging Face, and can be downloaded in subfiles by parameters, but are unoptimized in our data interface.
5+
* `.zarr` files enable fast querying and processing, but they must be downloaded as a complete archive representing an entire network.
6+
7+
To download, please visit the Hugging Face [repository](https://huggingface.co/datasets/rugds/ditec-wdn/tree/main).
38

49
# Instal the Data Interface
5-
Currently, DiTEC-WDN is available for Python >= 3.10. Please setup a virtual environment before installation.
10+
DiTEC-WDN is available for Python >= 3.10. Please setup a virtual environment before installation.
611

712
As some libraries are tailored to your OS and CUDA, user should install them separately as follows:
813

@@ -17,5 +22,11 @@ Afterwards, you can clone DiTEC-WDN or install it via pip:
1722
pip install git+https://github.com/DiTEC-project/DiTEC_WDN_dataset.git
1823
```
1924

20-
Tada! DiTEC-WDN data interface has been installed!
25+
Then, required libraries are listed in `requirements.txt` that can be downloaded using this command:
26+
27+
```python
28+
pip install -R requirments.txt
29+
```
30+
31+
Tada! DiTEC-WDN data interface has been installed!
2132

0 commit comments

Comments
 (0)