Skip to content

Fetch packages from package-storage - #21

Merged
mtojek merged 5 commits into
elastic:masterfrom
mtojek:fetch-package-storage
May 18, 2020
Merged

Fetch packages from package-storage#21
mtojek merged 5 commits into
elastic:masterfrom
mtojek:fetch-package-storage

Conversation

@mtojek

@mtojek mtojek commented May 13, 2020

Copy link
Copy Markdown
Contributor

Changes:

  • modify the mage build to include packages from package-storage
  • allow to run mage build multiple times (don't re-checkout the package-storage)
  • remove dev/packages/alpha as they are in the package-storage (import recent alpha packages)
@mtojek
mtojek requested a review from ruflin May 13, 2020 10:55
@mtojek mtojek self-assigned this May 13, 2020
@elasticmachine

elasticmachine commented May 13, 2020

Copy link
Copy Markdown

💚 Build Succeeded

Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

Comment thread .gitignore Outdated
build
public

/dev/packages/storage No newline at end of file

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we put it under build/packages/storage instead?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, this one doesn't need special cleaning. Fixed.

@mtojek
mtojek requested a review from ruflin May 13, 2020 11:39
Comment thread magefile.go Outdated
tarGz = true
publicDir = "./public"
buildDir = "./build"
storageDir = "./dev/packages/storage"

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this still correct?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Leftover, not needed anymore.

@exekias

exekias commented May 13, 2020

Copy link
Copy Markdown

ey folks, trying to understand the workflow here. Why is integrations repo fetching packages from storage?

@mtojek

mtojek commented May 13, 2020

Copy link
Copy Markdown
Contributor Author

ey folks, trying to understand the workflow here. Why is integrations repo fetching packages from storage?

Packages served by the package-registry are stored in the package-storage. There are some of them that are internal/required like: base, endpoint, system. As they're not in the integrations repo, we need to fetch them from the package-storage.

Currently there are no simple ways of attaching more packages to the registry. I can look into possibilities and modify the registry, but changes the scope of this task a bit.

@ruflin

ruflin commented May 13, 2020

Copy link
Copy Markdown
Contributor

One reason are the required packages but there is also a very nice side effect here. As all the existing packages are pulled in, any testing of new packages together with Kibana is what it will look like in the end. Example:

Someone is working on the nginx package 1.3.2. The current version shipped is 1.3.1. 1.3.1 will be pulled in from the package-storage and 1.3.2 will be on top of it.

@mtojek

mtojek commented May 14, 2020

Copy link
Copy Markdown
Contributor Author
  • remove dev/packages/alpha as they are in the package-storage

This point depends on outcome of the discussion here: #15

@ruflin ruflin left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Change LGTM.

My understanding of this PR now:

  • package-storage are checked out into build directory so only change related to this is in the magefile
  • The diff on the alpha packages are coming from (version-)changes since this repo was created (mostly).
@mtojek
mtojek merged commit 3979920 into elastic:master May 18, 2020
@ycombinator ycombinator mentioned this pull request Feb 16, 2021
2 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

4 participants