PyTorch Packages and Dependencies - 7/17

Project Discussion
1

Here is the discussion for the list of packages and dependencies for our next meeting on 7/24.

2 Likes
2

Overview - epel/ebranch - Pagure.io is the dependency tracking tool @salimma developed to aid branching pakages for EPEL; we might be able to adapt/reuse some of the same logic to build out a dependency list for pytorch.

3

Yup. It’s been mostly working for what we needed (branching packages from Fedora → EPEL based of comparing what’s in Rawhide vs what’s in EL + EPEL), but bringing in dependencies from upstream to Fedora is certainly a natural extension, esp for those with a de facto upstream repository like PyPI for Python and crates.io for Rust.

4

I just did a spack https://spack.io/ build of pytorch ( pack install py-torch +rocm ~cuda +amdgpu_targetgfx906 )

It didn’t pick up any of the system dependencies and so it should have gotten most of the dependencies. The build failed on a couple of problems with ROCm but it mostly completed and so this may be a good place to start. It got 144/167 of the dependencies.

Obviously many of these are in the distro already.

  1. pkgconf
  2. ca-certificates-mozilla
  3. berkeley-db
  4. libiconv
  5. zlib
  6. gmake
  7. libmd
  8. xz
  9. zstd
  10. libffi
  11. re2c
  12. libsigsegv
  13. findutils
  14. util-macros
  15. libunwind
  16. libpthread-stubs
  17. xxd-standalone
  18. roctracer-dev-api
  19. pcre2
  20. half
  21. libyaml
  22. chrpath
  23. ncurses
  24. util-linux-uuid
  25. nghttp2
  26. libunistring
  27. diffutils
  28. pigz
  29. libbsd
  30. libxml2
  31. kbproto
  32. xproto
  33. glproto
  34. inputproto
  35. renderproto
  36. xextproto
  37. randrproto
  38. xtrans
  39. readline
  40. libedit
  41. libidn2
  42. bzip2
  43. m4
  44. expat
  45. libxau
  46. libxdmcp
  47. libice
  48. sqlite
  49. gdbm
  50. boost
  51. tar
  52. libtool
  53. libsm
  54. perl
  55. gettext
  56. libpciaccess
  57. perl-module-build
  58. openssl
  59. autoconf
  60. libxcrypt
  61. perl-file-which
  62. elfutils
  63. bison
  64. hwloc
  65. perl-uri-encode
  66. libevent
  67. curl
  68. automake
  69. python
  70. krb5
  71. flex
  72. pmix
  73. cmake
  74. numactl
  75. xcb-proto
  76. py-pip
  77. ninja
  78. openssh
  79. eigen
  80. msgpack-c
  81. nlohmann-json
  82. intel-tbb
  83. protobuf
  84. z3
  85. rocm-cmake
  86. rocm-smi-lib
  87. libxcb
  88. py-wheel
  89. py-setuptools
  90. fxdiv
  91. psimd
  92. pthreadpool
  93. git
  94. openmpi
  95. intel-oneapi-mkl
  96. llvm-amdgpu
  97. libx11
  98. py-flit-core
  99. py-protobuf
  100. py-editables
  101. py-charset-normalizer
  102. py-calver
  103. py-networkx
  104. py-pybind11
  105. meson
  106. py-certifi
  107. py-cython
  108. py-distlib
  109. py-urllib3
  110. py-ply
  111. py-six
  112. py-markupsafe
  113. valgrind
  114. libxrender
  115. libxext
  116. libxt
  117. py-pathspec
  118. py-idna
  119. py-tomli
  120. py-typing-extensions
  121. py-packaging
  122. py-trove-classifiers
  123. libdrm
  124. py-numpy
  125. py-msgpack
  126. py-pyyaml
  127. py-cppheaderparser
  128. py-astunparse
  129. py-mako
  130. py-jinja2
  131. libxrandr
  132. py-requests
  133. py-setuptools-scm
  134. hsakmt-roct
  135. xrandr
  136. py-mpmath
  137. py-pluggy
  138. py-tqdm
  139. py-sympy
  140. py-hatchling
  141. py-hatch-vcs
  142. py-platformdirs
  143. py-filelock
  144. py-virtualenv
5

Here’s a link to the meeting notes from today for anyone to reference: https://docs.google.com/document/d/1cJO98GqC2RXZPfy9Irpx0T6k8Sf-tPq-xdjW2yQUPLM/edit?usp=sharing

1 Like