Skip to content

LBRY on Kubernetes with Helm #71

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
Leopere merged 7 commits into from
Jun 15, 2019
Merged

LBRY on Kubernetes with Helm #71

Leopere merged 7 commits into from
Jun 15, 2019

Conversation

@EnigmaCurry
Copy link
Collaborator

@EnigmaCurry EnigmaCurry commented Apr 30, 2019 •
edited
Loading

This is a working Helm chart and HOWTO for running lbrycrd, chainquery, lbrynet, and spee.ch on Kubernetes, using the containers from this repo.

README

@EnigmaCurry
Copy link
Collaborator Author

EnigmaCurry commented Apr 30, 2019

This requires changes to the lbrycrd image outlined in #70

@EnigmaCurry EnigmaCurry mentioned this pull request Apr 30, 2019
Closed
@EnigmaCurry EnigmaCurry force-pushed the k8s-lbry branch 14 times, most recently from 5f4b0c4 to 3166c65 Compare May 1, 2019 01:00
@Leopere Leopere self-requested a review May 1, 2019 03:04
@lbry-bot lbry-bot assigned Leopere and unassigned Leopere May 1, 2019
@Leopere Leopere added priority: low Work should be done but can stay in the backlog for now type: new feature New functionality that does not exist yet type: testing Solution needs additional user testing labels May 1, 2019
@Leopere Leopere added this to the Wants milestone May 1, 2019
@Leopere
Copy link
Collaborator

Leopere commented May 1, 2019

Would you be interested in showing a reasonable platform agnostic playthrough of this guide via a video similar to your Cloud-init?

@EnigmaCurry EnigmaCurry force-pushed the k8s-lbry branch 5 times, most recently from 1521eff to 06b8713 Compare May 1, 2019 22:09
@EnigmaCurry EnigmaCurry force-pushed the k8s-lbry branch 8 times, most recently from 990c708 to 9a7dee8 Compare May 30, 2019 20:32
@EnigmaCurry
k8s-lbry: Adds bash wrapper run.sh and new configs
8aeee36 
Squashed commit of the following:

commit ce1e033
Author: Ryan McGuire <ryan@enigmacurry.com>
Date:   Fri May 17 09:04:05 2019 -0400

    Added spee.ch README and speech-lbrynet services.

commit 7aa73f3
Author: Ryan McGuire <ryan@enigmacurry.com>
Date:   Thu May 16 19:03:28 2019 -0400

    Fix Speech downloads dirs

commit 3137b0c
Author: Ryan McGuire <ryan@enigmacurry.com>
Date:   Thu May 16 17:52:55 2019 -0400

    speech-lbrynet should mount speech-data volume to store downloads.

commit 727c598
Author: Ryan McGuire <ryan@enigmacurry.com>
Date:   Thu May 16 17:40:34 2019 -0400

    applying shell-check (part 1)

commit 251e2b1
Author: Ryan McGuire <ryan@enigmacurry.com>
Date:   Wed May 15 20:43:18 2019 -0400

    TLS / HTTPs

commit b3de768
Author: Ryan McGuire <ryan@enigmacurry.com>
Date:   Wed May 15 17:51:52 2019 -0400

    Spee.ch+lbrynet sidecar (in progress)

commit 1eb08ae
Author: Ryan McGuire <ryan@enigmacurry.com>
Date:   Tue May 14 10:43:20 2019 -0400

    Add asciicast

commit 067e9c8
Author: Ryan McGuire <ryan@enigmacurry.com>
Date:   Mon May 13 09:49:50 2019 -0400

    Updates lbrynet image

commit b85026d
Author: Ryan McGuire <ryan@enigmacurry.com>
Date:   Mon May 13 08:36:40 2019 -0400

    README

commit 1f5bd11
Author: Ryan McGuire <ryan@enigmacurry.com>
Date:   Sun May 12 21:40:46 2019 -0400

    fix helm app names

commit 28ea709
Author: Ryan McGuire <ryan@enigmacurry.com>
Date:   Sun May 12 21:31:22 2019 -0400

    lbrycrd-override-snapshot

commit 0d5b2ae
Author: Ryan McGuire <ryan@enigmacurry.com>
Date:   Sun May 12 21:00:24 2019 -0400

    remove set -x

commit b2d3801
Author: Ryan McGuire <ryan@enigmacurry.com>
Date:   Sun May 12 20:41:18 2019 -0400

    fix lbrynet-copy-wallet

commit 2dcb98d
Author: Ryan McGuire <ryan@enigmacurry.com>
Date:   Sun May 12 20:29:59 2019 -0400

    run.sh messaging

commit b766ffc
Author: Ryan McGuire <ryan@enigmacurry.com>
Date:   Sun May 12 20:21:21 2019 -0400

    fix linkages

commit 4d07652
Author: Ryan McGuire <ryan@enigmacurry.com>
Date:   Sun May 12 19:39:23 2019 -0400

    fix container linkage

commit 8f4bd26
Author: Ryan McGuire <ryan@enigmacurry.com>
Date:   Sun May 12 19:26:53 2019 -0400

    run.sh help

commit ef2f0fe
Author: Ryan McGuire <ryan@enigmacurry.com>
Date:   Sun May 12 18:43:43 2019 -0400

    remove old messaging

commit b8a6696
Author: Ryan McGuire <ryan@enigmacurry.com>
Date:   Sun May 12 17:19:33 2019 -0400

    add setup-alias command

commit fbc5c20
Author: Ryan McGuire <ryan@enigmacurry.com>
Date:   Sun May 12 16:06:04 2019 -0400

    README

commit 34410c1
Author: Ryan McGuire <ryan@enigmacurry.com>
Date:   Sun May 12 15:51:20 2019 -0400

    Depend on external kubectl and helm tab completion scripts.

commit a9af588
Author: Ryan McGuire <ryan@enigmacurry.com>
Date:   Sun May 12 15:23:35 2019 -0400

    Fix tab completion script

commit c82efd5
Author: Ryan McGuire <ryan@enigmacurry.com>
Date:   Sun May 12 15:12:21 2019 -0400

    Refactor run.sh script to k8s-lbry alias.

commit d14eb66
Author: Ryan McGuire <ryan@enigmacurry.com>
Date:   Sun May 12 14:44:16 2019 -0400

    Fix tab completion script.

commit 77ecaab
Author: Ryan McGuire <ryan@enigmacurry.com>
Date:   Sun May 12 14:22:25 2019 -0400

    Fix kubectl namespace during tab completion

commit 29ff6d2
Author: Ryan McGuire <ryan@enigmacurry.com>
Date:   Sun May 12 12:13:03 2019 -0400

    k8s-lbry: Adds tab completion

commit da961eb
Author: Ryan McGuire <ryan@enigmacurry.com>
Date:   Sat May 11 20:54:43 2019 -0400

    README

commit 934e43b
Author: Ryan McGuire <ryan@enigmacurry.com>
Date:   Sat May 11 20:23:03 2019 -0400

    Chainquery snapshot restore

commit 5602926
Author: Ryan McGuire <ryan@enigmacurry.com>
Date:   Sat May 11 18:13:58 2019 -0400

    lbrycrd-cli credentials

commit 03bc538
Author: Ryan McGuire <ryan@enigmacurry.com>
Date:   Sat May 11 18:07:25 2019 -0400

    Open port 9246

commit 339688b
Author: Ryan McGuire <ryan@enigmacurry.com>
Date:   Sat May 11 17:37:15 2019 -0400

    delete old package script

commit 4cef338
Author: Ryan McGuire <ryan@enigmacurry.com>
Date:   Sat May 11 17:31:17 2019 -0400

    fix pod names

commit babcb68
Author: Ryan McGuire <ryan@enigmacurry.com>
Date:   Sat May 11 16:47:30 2019 -0400

    more

commit 88192a8
Author: Ryan McGuire <ryan@enigmacurry.com>
Date:   Sat May 11 16:13:27 2019 -0400

    enable args

commit 01bcf85
Author: Ryan McGuire <ryan@enigmacurry.com>
Date:   Sat May 11 15:55:14 2019 -0400

    more

commit 76ab501
Author: Ryan McGuire <ryan@enigmacurry.com>
Date:   Sat May 11 15:41:36 2019 -0400

    k8s-lbry: lbrynet

commit 3432c9e
Author: Ryan McGuire <ryan@enigmacurry.com>
Date:   Sat May 11 11:41:32 2019 -0400

    README

commit 813b6ab
Author: Ryan McGuire <ryan@enigmacurry.com>
Date:   Sat May 11 11:40:02 2019 -0400

    fix regex

commit d010eb5
Author: Ryan McGuire <ryan@enigmacurry.com>
Date:   Sat May 11 11:36:47 2019 -0400

    Add git dependency

commit 092c496
Author: Ryan McGuire <ryan@enigmacurry.com>
Date:   Sat May 11 11:27:14 2019 -0400

    Fix helm

commit fa7dea7
Author: Ryan McGuire <ryan@enigmacurry.com>
Date:   Sat May 11 10:57:17 2019 -0400

    Make run.sh bootstrappable

commit f512878
Author: Ryan McGuire <ryan@enigmacurry.com>
Date:   Sat May 11 10:21:35 2019 -0400

    k8s-lbry: README

commit fd77fa2
Author: Ryan McGuire <ryan@enigmacurry.com>
Date:   Wed May 8 02:50:24 2019 -0400

    k8s-lbry: Adds run.sh wrapper script and new README.
@EnigmaCurry
Copy link
Collaborator Author

EnigmaCurry commented May 30, 2019 •
edited
Loading 

2019-05-30T21:16:20.981Z - error: Error on /api/file/availability/479364455881011fc6306o2600/86e53ddc594fcc13e558dc0c1f94b31f4ee1fb99 
{ stack: 'TypeError: Cannot read property \'dataValues\' of null\n    at /spee.ch/server/bundle/server.js:1:638181\n    at <anonymous>',
  message: 'Cannot read property \'dataValues\' of null' }
  • Once the claim is accepted onto the blockchain, the image resolves correctly.
  • Test page (temporarily online only) : https://speech.rymcg.tech/8/479364455881011fc6306o2600
  • Publishing within a channel is not working, with an error message of no channel password provided, although logging into the channel appears to work, and I do see the password in the log when the account was created.
  • run.sh still points to my forked helm chart values, this still needs to be switched before merged.
  • values.yaml contains docker images for my own repository that needs to be switched once we have spee.ch and lbrynet (v0.37.2) production images.
  • I added the asciicast directly to the contrib/k8s-lbry/kick-ascii directory. Turn on github pages in the repository settings for the master branch.
  • There is a helm repository created on S3 that is being used currently, this could be migrated to github pages as well. That would mean mainting a full history of tarballed helm chart releases in contrib/k8s-lbry/repository. Alternatively, we could just keep it as S3, and host it elsewhere. I think the latter option is a bit cleaner.

Leopere
Leopere requested changes Jun 14, 2019
View reviewed changes
Copy link
Collaborator

@Leopere Leopere left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks like the Readme is 97% of the way there let us get it the last 3% and I'll push this into the repository!

@lbry-bot lbry-bot assigned Leopere and unassigned Leopere Jun 14, 2019
@EnigmaCurry EnigmaCurry requested a review from Leopere June 14, 2019 20:57
@lbry-bot lbry-bot assigned Leopere and unassigned Leopere Jun 14, 2019
@Leopere
Copy link
Collaborator

Leopere commented Jun 14, 2019

Just waiting on @tiger5226 to enable the github pages for this repo so I can rebase and merge this at this point.

@lbry-bot lbry-bot assigned Leopere and unassigned Leopere Jun 14, 2019
@tiger5226
Copy link
Contributor

tiger5226 commented Jun 15, 2019

its enabled

@Leopere Leopere merged commit 8b8e97b into lbryio:master Jun 15, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@Leopere Leopere Leopere approved these changes

Assignees

@Leopere Leopere

Labels

priority: low Work should be done but can stay in the backlog for now type: new feature New functionality that does not exist yet type: testing Solution needs additional user testing

Projects

None yet

Milestone

Wants

Development

Successfully merging this pull request may close these issues.

3 participants

@EnigmaCurry @Leopere @tiger5226