Skip to content

Commit c966190

Browse files
author
Yehor Maksymchuk
committed
EZSPA-698: Add Docker file and README
1 parent 14590e7 commit c966190

File tree

2 files changed

+7
-25
lines changed

2 files changed

+7
-25
lines changed

examples/spark-3.2.0/crs/gpu/README.md

Lines changed: 0 additions & 25 deletions
Original file line numberDiff line numberDiff line change
@@ -24,29 +24,4 @@ spark.conf:
2424
*(1) Filter NOT (value#2 = 1)
2525
+- *(1) SerializeFromObject [input[0, int, false] AS value#2]
2626
+- Scan[obj#1]
27-
```
28-
29-
30-
## Running spark-rapids-integration-tests
31-
32-
1. Clone project
33-
```shell
34-
Git clone https://github.com/NVIDIA/spark-rapids.git \
35-
```
36-
2.Copy integration_tests to maprfs \
37-
38-
```shell
39-
40-
kubectl cp integration_tests to maprfs
41-
```
42-
43-
3.Start integration test execution \
44-
45-
```shell
46-
kubectl apply -f it-executor.yaml
47-
```
48-
4. To run specific test modify spark-rapids-it-runner.yaml
49-
50-
```yaml
51-
# - -k explain_test # specific test for execution
5227
```

testing/spark/gpu/Dockerfile

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,7 @@
1+
FROM gcr.io/mapr-252711/spark-gpu-3.2.0:${latest tag}
2+
RUN pip3 install --upgrade pip
3+
RUN sudo ln /usr/local/bin/pip /usr/bin/pip
4+
RUN sudo -u mapr pip install numpy pandas pyarrow pytest sre_yield
5+
RUN yum install git -y
6+
USER mapr
7+
RUN git clone -b branch-${branch version} --single-branch https://github.com/NVIDIA/spark-rapids.git /tmp/spark-rapids

0 commit comments

Comments
 (0)