mirror of
https://github.com/chromebrew/chromebrew.git
synced 2026-01-09 15:37:56 -05:00
Python => 3.13.0 (#10585)
* Python => 3.13 Signed-off-by: Satadru Pramanik <satadru@gmail.com> * fix VER variables in const.rb Signed-off-by: Satadru Pramanik <satadru@gmail.com> * bugfixes Signed-off-by: Satadru Pramanik <satadru@gmail.com> * More plumbing changes... Signed-off-by: Satadru Pramanik <satadru@gmail.com> * Adjust py3_pip and py3_setuptools to not error during python3 preinstall. Signed-off-by: Satadru Pramanik <satadru@gmail.com> * fix hash error Signed-off-by: Satadru Pramanik <satadru@gmail.com> * Add no_binaries_needed Signed-off-by: Satadru Pramanik <satadru@gmail.com> * bugfixes... Signed-off-by: Satadru Pramanik <satadru@gmail.com> * Add PYO3_USE_ABI3_FORWARD_COMPATIBILITY=1 to pip.rb to fix python 3.13 builds. Signed-off-by: Satadru Pramanik <satadru@gmail.com> * Add workaround for missing binaries... Signed-off-by: Satadru Pramanik <satadru@gmail.com> * update cmake Signed-off-by: Satadru Pramanik <satadru@gmail.com> * Add lots of package updates. Signed-off-by: Satadru Pramanik <satadru@gmail.com> * Add py3_bcrypt, rename asciidoc, add more package builds. Signed-off-by: Satadru Pramanik <satadru@gmail.com> * More updates Signed-off-by: Satadru Pramanik <satadru@gmail.com> * revert postgresql update Signed-off-by: Satadru Pramanik <satadru@gmail.com> * final updates? Signed-off-by: Satadru Pramanik <satadru@gmail.com> * update curl Signed-off-by: Satadru Pramanik <satadru@gmail.com> * lint Signed-off-by: Satadru Pramanik <satadru@gmail.com> * Add curl to essential packages to try to prevent unit test failure on i686. Signed-off-by: Satadru Pramanik <satadru@gmail.com> * updates Signed-off-by: Satadru Pramanik <satadru@gmail.com> * lint Signed-off-by: Satadru Pramanik <satadru@gmail.com> * fix accidental change to docker package. Signed-off-by: Satadru Pramanik <satadru@gmail.com> * Fiz condition of no new updates leavimg a message with CREW_UNATTENDED set. Signed-off-by: Satadru Pramanik <satadru@gmail.com> * more updates, add missing libabigail binaries Signed-off-by: Satadru Pramanik <satadru@gmail.com> * rebuild py3_dbus_python Signed-off-by: Satadru Pramanik <satadru@gmail.com> * add arm build for 5.10 musl_linuxheaders Signed-off-by: Satadru Pramanik <satadru@gmail.com> * Add builds for openimageio. Signed-off-by: Satadru Pramanik <satadru@gmail.com> * Adjust ruby buildsystem slightly to use cache more, adjust unit tests to properly invoke setarch, add py3_pynacl, update libsodium. Signed-off-by: Satadru Pramanik <satadru@gmail.com> * Ruby adjustments... Signed-off-by: Satadru Pramanik <satadru@gmail.com> * unit test adjustments... Signed-off-by: Satadru Pramanik <satadru@gmail.com> * unit test adjustments... Signed-off-by: Satadru Pramanik <satadru@gmail.com> * Add error message to pip install... Signed-off-by: Satadru Pramanik <satadru@gmail.com> * expand pip error reporting Signed-off-by: Satadru Pramanik <satadru@gmail.com> * More pip adjustments. Signed-off-by: Satadru Pramanik <satadru@gmail.com> * Add more pip verbose error reporting. Signed-off-by: Satadru Pramanik <satadru@gmail.com> * Add new workaround for pip failure on i686... Signed-off-by: Satadru Pramanik <satadru@gmail.com> * Refactor pip again... Signed-off-by: Satadru Pramanik <satadru@gmail.com> * more refactoring... Signed-off-by: Satadru Pramanik <satadru@gmail.com> * Adjust py3_pip version restriction. Signed-off-by: Satadru Pramanik <satadru@gmail.com> * Avoid container jdk dependency in snowflake. Signed-off-by: Satadru Pramanik <satadru@gmail.com> * update trove classifiers. Signed-off-by: Satadru Pramanik <satadru@gmail.com> * adjust package fxn exit Signed-off-by: Satadru Pramanik <satadru@gmail.com> * adjust more jdk deps Signed-off-by: Satadru Pramanik <satadru@gmail.com> --------- Signed-off-by: Satadru Pramanik <satadru@gmail.com>
This commit is contained in:
Satadru Pramanik, DO, MPH, MEng
committed by
GitHub
GitHub
parent
c5d380d1a6
commit
79efa1dfd5
@@ -3,20 +3,51 @@ Encoding.default_internal = Encoding::UTF_8
|
||||
require 'json'
|
||||
require 'package'
|
||||
|
||||
def get_pip_info(pip_pkg_name = nil)
|
||||
@pip_show = nil
|
||||
@pip_pkg_version = nil
|
||||
@pip_show_location = nil
|
||||
@pip_show_files = []
|
||||
@pip_show = `python3 -s -m pip --no-color show -f #{pip_pkg_name}`.chomp
|
||||
# Error out if the pip install has no files.
|
||||
unless @pip_show.include?('Files:')
|
||||
puts @pip_show
|
||||
puts "pip install of #{pip_pkg_name} failed.".lightred
|
||||
return false
|
||||
end
|
||||
@pip_pkg_version = @pip_show[/(?<=Version: ).*/, 0]
|
||||
@pip_show_location = @pip_show[/(?<=Location: ).*/, 0].concat('/')
|
||||
@pip_show_files = @pip_show[/(?<=Files:\n)[\W|\w]*/, 0].split
|
||||
return true
|
||||
end
|
||||
|
||||
def pip_hard_reinstall
|
||||
puts "Cleaning #{@py_pkg} and attempting reinstall...".lightpurple
|
||||
# Try installing from network wheels
|
||||
# as per https://stackoverflow.com/a/71119218
|
||||
pip_site_packages_folder = `python3 -c "import sysconfig; print(sysconfig.get_paths()['purelib'])"`.chomp
|
||||
Kernel.system 'python3 -m pip install trash-cli'
|
||||
Kernel.system "trash-put #{pip_site_packages_folder}/#{@py_pkg}*"
|
||||
Kernel.system "PYO3_USE_ABI3_FORWARD_COMPATIBILITY=1 python3 -m pip install --force-reinstall --upgrade '#{@py_pkg}==#{@py_pkg_chromebrew_version}'"
|
||||
get_pip_info(@py_pkg)
|
||||
end
|
||||
|
||||
class Pip < Package
|
||||
property :pip_install_extras, :pre_configure_options
|
||||
|
||||
def self.install
|
||||
@pip_cache_dir = `pip cache dir`.chomp
|
||||
@pip_cache_dest_dir = File.join(CREW_DEST_DIR, @pip_cache_dir)
|
||||
|
||||
# Make sure Chromebrew pypi variables are set.
|
||||
# These need to be set as global or they don't work.
|
||||
pip_config = `pip config list`.chomp
|
||||
Kernel.system "pip config --user set global.index-url #{CREW_GITLAB_PKG_REPO}/pypi/simple", %i[err out] => File::NULL unless pip_config.include?("global.index-url='#{CREW_GITLAB_PKG_REPO}'")
|
||||
Kernel.system 'pip config --user set global.extra-index-url https://pypi.org/simple', %i[err out] => File::NULL unless pip_config.include?("global.extra-index-url='https://pypi.org/simple'")
|
||||
Kernel.system 'pip config --user set global.trusted-host gitlab.com', %i[err out] => File::NULL unless pip_config.include?("global.trusted-host='gitlab.com'")
|
||||
pip_cache_dir = `pip cache dir`.chomp
|
||||
|
||||
puts 'Checking for pip updates'.orange if CREW_VERBOSE
|
||||
system "python3 -s -m pip install -U pip | grep -v 'Requirement already satisfied'", exception: false
|
||||
puts 'Updating pip...'.orange unless `python3 -s -m pip install --no-color -U pip`.include?('Requirement already satisfied')
|
||||
@py_pkg = name.gsub('py3_', '')
|
||||
@py_pkg_chromebrew_version = version.gsub(/-py3\.\d{2}/, '').gsub(/-icu\d{2}\.\d/, '')
|
||||
puts "Checking for #{@py_pkg} python dependencies...".orange if CREW_VERBOSE
|
||||
@@ -34,31 +65,58 @@ class Pip < Package
|
||||
@py_pkg_deps.each do |pip_dep|
|
||||
@cleaned_py_dep = pip_dep[/[^;]+/]
|
||||
puts "——Installing: #{@cleaned_py_dep}".gray
|
||||
system "python3 -s -m pip install --ignore-installed -U \"#{@cleaned_py_dep}\" | grep -v 'Requirement already satisfied'", exception: false
|
||||
system "PYO3_USE_ABI3_FORWARD_COMPATIBILITY=1 python3 -s -m pip install #{prerelease? ? '--pre' : ''} --ignore-installed -U \"#{@cleaned_py_dep}\" | grep -v 'Requirement already satisfied'", exception: false
|
||||
end
|
||||
end
|
||||
puts "Installing #{@py_pkg} python module. This may take a while...".lightblue
|
||||
puts "Additional pre_configure_options being used: #{@pre_configure_options.nil? ? '<no pre_configure_options>' : @pre_configure_options}".orange
|
||||
puts "#{@py_pkg.capitalize} is configured to install a pre-release version." if prerelease?
|
||||
system "MAKEFLAGS=-j#{CREW_NPROC} #{@pre_configure_options} python -s -m pip install --ignore-installed -U \"#{@py_pkg}==#{@py_pkg_chromebrew_version}\" | grep -v 'Requirement already satisfied'", exception: false
|
||||
|
||||
if @source_url == 'SKIP'
|
||||
system "pip wheel -w #{pip_cache_dir} #{@py_pkg}"
|
||||
# Build wheel if pip install fails, since that implies a wheel isn't available.
|
||||
puts "Trying to install #{@py_pkg}==#{@py_pkg_chromebrew_version}" if CREW_DEBUG
|
||||
Kernel.system "PYO3_USE_ABI3_FORWARD_COMPATIBILITY=1 MAKEFLAGS=-j#{CREW_NPROC} #{@pre_configure_options} python3 -s -m pip install --no-warn-conflicts --force-reinstall #{prerelease? ? '--pre' : ''} --no-deps --ignore-installed -U --only-binary :all: #{@py_pkg}==#{@py_pkg_chromebrew_version}"
|
||||
get_pip_info(@py_pkg)
|
||||
pip_hard_reinstall unless @py_pkg_chromebrew_version == @pip_pkg_version
|
||||
if CREW_DEBUG
|
||||
puts "@py_pkg_chromebrew_version is #{@py_pkg_chromebrew_version}"
|
||||
puts "@pip_pkg_version is #{@pip_pkg_version}"
|
||||
end
|
||||
if @py_pkg_chromebrew_version == @pip_pkg_version
|
||||
puts "A wheel for #{@py_pkg}==#{@py_pkg_chromebrew_version} was found!".lightblue
|
||||
else
|
||||
system "pip wheel -w #{pip_cache_dir} git+#{source_url}"
|
||||
puts "A wheel for #{@py_pkg}==#{@py_pkg_chromebrew_version} was unavailable, so we will build a wheel.".orange
|
||||
Kernel.system "PYO3_USE_ABI3_FORWARD_COMPATIBILITY=1 python3 -m pip install #{prerelease? ? '--pre' : ''} --force-reinstall --upgrade '#{@py_pkg}==#{@py_pkg_chromebrew_version}'" unless prerelease?
|
||||
# Assume all pip non-SKIP sources are git.
|
||||
@pip_wheel = if @source_url == 'SKIP'
|
||||
`PYO3_USE_ABI3_FORWARD_COMPATIBILITY=1 MAKEFLAGS=-j#{CREW_NPROC} #{@pre_configure_options} python3 -m pip wheel #{prerelease? ? '--pre' : ''} -w #{@pip_cache_dir} #{@py_pkg}==#{@py_pkg_version}`[/(?<=filename=)(.*)*?(\S+)/, 0]
|
||||
else
|
||||
`PYO3_USE_ABI3_FORWARD_COMPATIBILITY=1 MAKEFLAGS=-j#{CREW_NPROC} #{@pre_configure_options} python3 -m pip wheel #{prerelease? ? '--pre' : ''} -w #{@pip_cache_dir} git+#{source_url}`[/(?<=filename=)(.*)*?(\S+)/, 0]
|
||||
end
|
||||
puts "@pip_wheel is #{@pip_wheel}" if CREW_DEBUG
|
||||
FileUtils.install File.join(@pip_cache_dir, @pip_wheel), @pip_cache_dest_dir
|
||||
Kernel.system "python3 -m pip install #{prerelease? ? '--pre' : ''} --force-reinstall --upgrade #{File.join(@pip_cache_dir, @pip_wheel)}"
|
||||
# Check the just-installed package...
|
||||
if get_pip_info(@py_pkg)
|
||||
puts "Note that #{@py_pkg}==#{@pip_pkg_version} is installed, which is different from the #{@py_pkg_chromebrew_version}. Please update the package file.".lightpurple if @py_pkg_chromebrew_version != @pip_pkg_version
|
||||
else
|
||||
pip_hard_reinstall
|
||||
end
|
||||
end
|
||||
|
||||
@pip_files = `python3 -s -m pip show -f #{@py_pkg}`.chomp
|
||||
abort "pip install of #{@py_pkg} failed." if @pip_files.empty?
|
||||
@pip_files_base = @pip_files[/(?<=Location: ).*/, 0].concat('/')
|
||||
@pip_files_lines = @pip_files[/(?<=Files:\n)[\W|\w]*/, 0].split
|
||||
@pip_files_lines.each do |pip_file|
|
||||
@pip_path = File.expand_path("#{@pip_files_base}#{pip_file}")
|
||||
@destpath = File.join(CREW_DEST_DIR, @pip_path)
|
||||
abort "#{@py_pkg} could not installed!".lightred unless get_pip_info(@py_pkg)
|
||||
@pip_show_files.each do |pip_file|
|
||||
@pip_file_path = File.expand_path("#{@pip_show_location}#{pip_file}")
|
||||
@pip_file_destpath = File.join(CREW_DEST_DIR, @pip_file_path)
|
||||
# Handle older FileUtils from older ruby versions.
|
||||
FileUtils.mkdir_p File.dirname(@destpath) if Gem::Version.new(RUBY_VERSION.to_s) < Gem::Version.new('3.3')
|
||||
FileUtils.install @pip_path, @destpath
|
||||
FileUtils.mkdir_p File.dirname(@pip_file_destpath) if Gem::Version.new(RUBY_VERSION.to_s) < Gem::Version.new('3.3')
|
||||
begin
|
||||
FileUtils.install @pip_file_path, @pip_file_destpath
|
||||
rescue Errno::ENOENT
|
||||
puts @pip_show_files
|
||||
abort "Problem installing #{@pip_file_path} from #{@py_pkg}==#{@pip_pkg_version} to #{@pip_file_destpath}".lightred
|
||||
end
|
||||
end
|
||||
@pip_install_extras&.call
|
||||
puts "#{@py_pkg}==#{@pip_pkg_version} installed.".lightgreen
|
||||
end
|
||||
end
|
||||
|
||||
Reference in New Issue
Block a user