Post Project
Continue with Facebook
Continue with LinkedIn
Amzon EMR - Solve a bug
Project # 116729
Hot
Job Statistics
| 0 Bids |
budget
Up to 2,500 ILS
|
bidding ends in
bidding closed
|
bid range
-
|
average bid
-
|
Job Info And Actions
Email
Report
Posted:
20:29, 8 Jul., 2017
Ends:
13:01, 29 Aug., 2017
Amzon EMR - Solve a bug
In an EMR cluster - running a pyspark job works fine from the command line but fail when running from an EMR-step.
Details
SSH into the EMR master and running my pyspark job using spark-submit - it works fin on all executors.
When running the same job using an EMR-step (and a jar running spark-sbumit) - the job only runs on the driver.
If you think you can help - please let me know.
Details
SSH into the EMR master and running my pyspark job using spark-submit - it works fin on all executors.
When running the same job using an EMR-step (and a jar running spark-sbumit) - the job only runs on the driver.
If you think you can help - please let me know.
skills required
attachments
Files are not available as project is already expired
the client
Please
sign in
to contact the client
updates
Please sign in to view project updates
Jobs on XPlace
This and thousands of similar projects are posted every day on XPlace to help you find the best experts and freelancers.
Bid
on this project
0 Bids
Bids will appear here shortly.