Skip to content

Package Index: Build in Dockerhub#13810

Merged
ax3l merged 3 commits intospack:developfrom
ax3l:topic-packageIndexDockerhubBuild
Nov 26, 2019
Merged

Package Index: Build in Dockerhub#13810
ax3l merged 3 commits intospack:developfrom
ax3l:topic-packageIndexDockerhubBuild

Conversation

@ax3l
Copy link
Copy Markdown
Member

@ax3l ax3l commented Nov 20, 2019

Prepare to build the package index service, packages.spack.io, on Dockerhub.

Local build (in spack root dir):

docker build -t spack/packages.spack.io:latest -f share/spack/docker/package-index/Dockerfile .

Local test:

docker run -p 8080:80 spack/packages.spack.io:latest

Follow-up to #11665 and #11621

@ax3l ax3l added documentation Improvements or additions to documentation docker labels Nov 20, 2019
@ax3l ax3l requested review from opadron and tgamblin November 20, 2019 19:00
@ax3l ax3l force-pushed the topic-packageIndexDockerhubBuild branch from 55c04c2 to 778daa2 Compare November 20, 2019 19:09
Copy link
Copy Markdown
Member

@alalazo alalazo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just a few comments from trying the commands in the description and failing to execute them.

@ax3l ax3l force-pushed the topic-packageIndexDockerhubBuild branch 4 times, most recently from 52d8d93 to 102956e Compare November 20, 2019 21:31
ax3l added 2 commits November 20, 2019 14:33
Prepare to build the package index service, packages.spack.io,
on Dockerhub.

Local build (in spack root dir):
```
docker build -t spack/packages.spack.io:latest -f share/spack/docker/package-index/Dockerfile .
```

Local test:
```
docker run -p 8080:80 spack/packages.spack.io:latest
```
Remove leftover docker stages from Travis-CI.
@ax3l ax3l force-pushed the topic-packageIndexDockerhubBuild branch from 102956e to 7d8b620 Compare November 20, 2019 21:33
@ax3l
Copy link
Copy Markdown
Member Author

ax3l commented Nov 20, 2019

@alalazo thank you for the review, my last updates did not reach GitHub it seams. I am sorry for that.
I also added a README now in the same directory, pointing to the related services this interfaces with.

@alalazo
Copy link
Copy Markdown
Member

alalazo commented Nov 20, 2019

I am sorry for that.

No need to be, happy to review your PRs 🤓


The API is a simple, file-based JSON index.
A specific package can be queried via the URI syntax:
``https://packages.spack.io/api/:firstLetter/:packageName.json``
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is more curiosity on my part than anything else, but why the :firstLetter part? Is that part of some standard that this service is trying to adhere to?

Copy link
Copy Markdown
Member Author

@ax3l ax3l Nov 25, 2019

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is just me trying to implement a very naïve load balancing to split the cost of a 4k inode ls.

ls var/spack/repos/builtin/packages/ | wc -l
3695

There are probably simpler ways to hide this via nginx configs?

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am anticipating 100k+ packages in Spack

@ax3l ax3l merged commit 7a81c37 into spack:develop Nov 26, 2019
@ax3l ax3l deleted the topic-packageIndexDockerhubBuild branch November 26, 2019 17:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

docker documentation Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants