Not pip installable from Databricks

[michael-berk]

How can we make this repo pip installable from a Databricks notebook?

When running pip install git+https://github.com/goodwillpunning/beaker, we get the following error. The same error is not observed on a local version (terminal). Pip version is 22.3.1, but the same error is observed for earlier versions.

Python interpreter will be restarted.
Collecting git+https://github.com/goodwillpunning/beaker
  Cloning https://github.com/goodwillpunning/beaker to /tmp/pip-req-build-oxsxpehl
  Running command git clone --filter=blob:none --quiet https://github.com/goodwillpunning/beaker /tmp/pip-req-build-oxsxpehl
  Resolved https://github.com/goodwillpunning/beaker to commit fca44d78c17780189c605155e266cc124b075ad8
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'error'
  error: subprocess-exited-with-error
  
  × Preparing metadata (pyproject.toml) did not run successfully.
  │ exit code: 1
  ╰─> [33 lines of output]
      Traceback (most recent call last):
        File "/local_disk0/.ephemeral_nfs/envs/pythonEnv-660b5dd6-6fc3-431a-9bb7-402e6344dd81/lib/python3.9/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 144, in prepare_metadata_for_build_wheel
          hook = backend.prepare_metadata_for_build_wheel
      AttributeError: module 'hatchling.build' has no attribute 'prepare_metadata_for_build_wheel'
      
      During handling of the above exception, another exception occurred:
      
      Traceback (most recent call last):
        File "/local_disk0/.ephemeral_nfs/envs/pythonEnv-660b5dd6-6fc3-431a-9bb7-402e6344dd81/lib/python3.9/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 351, in <module>
          main()
        File "/local_disk0/.ephemeral_nfs/envs/pythonEnv-660b5dd6-6fc3-431a-9bb7-402e6344dd81/lib/python3.9/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 333, in main
          json_out['return_val'] = hook(**hook_input['kwargs'])
        File "/local_disk0/.ephemeral_nfs/envs/pythonEnv-660b5dd6-6fc3-431a-9bb7-402e6344dd81/lib/python3.9/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 148, in prepare_metadata_for_build_wheel
          whl_basename = backend.build_wheel(metadata_directory, config_settings)
        File "/tmp/pip-build-env-aji0qqz3/overlay/lib/python3.9/site-packages/hatchling/build.py", line 56, in build_wheel
          return os.path.basename(next(builder.build(wheel_directory, ['standard'])))
        File "/tmp/pip-build-env-aji0qqz3/overlay/lib/python3.9/site-packages/hatchling/builders/plugin/interface.py", line 158, in build
          artifact = version_api[version](directory, **build_data)
        File "/tmp/pip-build-env-aji0qqz3/overlay/lib/python3.9/site-packages/hatchling/builders/wheel.py", line 370, in build_standard
          for included_file in self.recurse_included_files():
        File "/tmp/pip-build-env-aji0qqz3/overlay/lib/python3.9/site-packages/hatchling/builders/plugin/interface.py", line 179, in recurse_included_files
          yield from self.recurse_selected_project_files()
        File "/tmp/pip-build-env-aji0qqz3/overlay/lib/python3.9/site-packages/hatchling/builders/plugin/interface.py", line 184, in recurse_selected_project_files
          yield from self.recurse_explicit_files(self.config.only_include)
        File "/tmp/pip-build-env-aji0qqz3/overlay/lib/python3.9/site-packages/hatchling/builders/plugin/interface.py", line 247, in recurse_explicit_files
          if self.config.include_path(relative_file_path, explicit=True, is_package=is_package):
        File "/tmp/pip-build-env-aji0qqz3/overlay/lib/python3.9/site-packages/hatchling/builders/config.py", line 94, in include_path
          and not self.path_is_excluded(relative_path)
        File "/tmp/pip-build-env-aji0qqz3/overlay/lib/python3.9/site-packages/hatchling/builders/config.py", line 106, in path_is_excluded
          if self.exclude_spec is None:
        File "/tmp/pip-build-env-aji0qqz3/overlay/lib/python3.9/site-packages/hatchling/builders/config.py", line 207, in exclude_spec
          self.__exclude_spec = pathspec.GitIgnoreSpec.from_lines(all_exclude_patterns)
      AttributeError: module 'pathspec' has no attribute 'GitIgnoreSpec'
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.

cc: @nishant-deshpande-db