Skip to content

v1.1.1
Compare
Choose a tag to compare
@xoen xoen released this 17 Dec 14:41
· 23 commits to main since this release
v1.1.1
8cb4286
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

allspark

Fix problems when running Spark jobs. This was caused by a mismatch between the pyspark version and the underlying Java packages used (see PR)

Notable versions

This image contains (from inspection on running container):

  • JupyterLab 2.2.9
  • Python 3.8.6
  • pyspark 3.0.1

Other

  • add an inspec test to check pyspark in the image can run Spark jobs
  • simplified pyspark config script

See PR: #53

Assets 2
Loading