Arch Linux User Repository

PKGBUILD has been updated. Major changes:

• Downloads Firefox ESR and localization using the source array. Files are saved for reuse.
• Saves freshly patched IceCat sources in a tarball for reuse.
• Saves the PGO profile for reuse.

Notes:

• Currently requires clang/llvm 17, which has to be built from AUR.
• Wayland users, consider setting _build_pgo_xvfb=false. This will use xwayland-run for profiling.
• PGO should work now, but if it doesn't and you're willing to go without, try _build_pgo=false.
• Running out of RAM? Try adding mk_add_options MOZ_PARALLEL_BUILD=___ around line 300. Pick a value less than number of cores and free RAM in GB. For example, on a system with 8 cores, 64GB total RAM, but only 6 GB free, the value should be set to 4 or 5.
  • If a few people can confirm this is helpful, I will consider adding it as an additional option.
  • Main resource hog seems to be linking libxul.so. Leave a comment if you have a potential solution.

Having problems? Please provide details: processor make and model, number of cores, free -m, full log in pastebin, whether using AUR helper/makepkg/clean chroot, etc.

It works. Please test.

@sp1d3rmxn will try disable-elf-hack now. Thanks!

@figue

Ok I tried changing line 68 to "en-US" for my locale but, that only resulted in a "/bin/sed: no input files" and I didn't feel like troubleshooting that so I tried something that was suggested in the bug report -> https://bugs.llvm.org/show_bug.cgi?id=43659 <- I posted on the firefox-esr build:

ac_add_options --disable-elf-hack

added in the "prepare()" section under the "#Features" heading like so:

.....

Features

ac_add_options --enable-alsa

ac_add_options --enable-jack

ac_add_options --enable-startup-notification

ac_add_options --disable-crashreporter

ac_add_options --disable-gconf

ac_add_options --disable-updater

ac_add_options --disable-tests

ac_add_options --disable-eme

ac_add_options --disable-elf-hack <------------ ADDED HERE

ac_add_options --with-app-basename=icecat

ac_add_options --with-app-name=icecat

END

}

I used your env speedup and also the regular method and the package now compiles.

I did not change the mtune or march or anything else and now this builds. I will try this also on the firefox-esr build and give an update there if successful.

On your end can you try making that little change in the PKGBUILD without the mtune/march forced to the generics? I saw you pushed a change in the PKGBUILD with your commit for that but, I didn't have to do that. So maybe you can revert if you find this successful?

@sp1d3rmxn I have forced flags in build() can you update your local repo and try again?

https://aur.archlinux.org/cgit/aur.git/commit/?h=icecat&id=c4b969693fb8

@sp1d3rmxn I have to compile IceCat with stock makepkg.conf, otherwise it fails.

Can you try to set these and try again?

CFLAGS="-march=x86-64 -mtune=generic -O2 -pipe -fno-plt"
CXXFLAGS="-march=x86-64 -mtune=generic -O2 -pipe -fno-plt"
LDFLAGS="-Wl,-O1,--sort-common,--as-needed,-z,relro,-z,now"

You can custom -j to your number of CPU cores, don't have to use default.

Also, you can compile with:

env _SPEED=y makepkg -sic

to speed up the initial process. Change line 68 of PKGBUILD (echo es-ES) to your desired locale you only want to process.

Still fucked:

38:21.03 Stack dump:

38:21.03 0. Program arguments: /usr/bin/clang-9 -cc1 -triple x86_64-unknown-linux-gnu -emit-obj -disable-free -disable-llvm-verifier -discard-value-names -main-file-name test-array.c -mrelocation-model pic -pic-level 2 -mthread-model posix -relaxed-aliasing -masm-verbose -mconstructor-aliases -fno-plt -munwind-tables -fuse-init-array -target-cpu broadwell -dwarf-column-info -debug-info-kind=limited -dwarf-version=4 -debugger-tuning=gdb -momit-leaf-frame-pointer -ffunction-sections -fdata-sections -coverage-notes-file /home/user/software/testing/icecat.loser/src/icecat-v68.3.0-gnu1/output/icecat-68.3.0/obj-x86_64-pc-linux-gnu/build/unix/elfhack/test-array.gcno -resource-dir /usr/lib/clang/9.0.0 -dependency-file .deps/test-array.o.pp -MT test-array.o -sys-header-deps -MP -include /home/user/software/testing/icecat.loser/src/icecat-v68.3.0-gnu1/output/icecat-68.3.0/config/gcc_hidden.h -include /home/user/software/testing/icecat.loser/src/icecat-v68.3.0-gnu1/output/icecat-68.3.0/obj-x86_64-pc-linux-gnu/mozilla-config.h -I /home/user/software/testing/icecat.loser/src/icecat-v68.3.0-gnu1/output/icecat-68.3.0/obj-x86_64-pc-linux-gnu/dist/system_wrappers -D NDEBUG=1 -D TRIMMED=1 -I /home/user/software/testing/icecat.loser/src/icecat-v68.3.0-gnu1/output/icecat-68.3.0/build/unix/elfhack -I /home/user/software/testing/icecat.loser/src/icecat-v68.3.0-gnu1/output/icecat-68.3.0/obj-x86_64-pc-linux-gnu/build/unix/elfhack -I /home/user/software/testing/icecat.loser/src/icecat-v68.3.0-gnu1/output/icecat-68.3.0/obj-x86_64-pc-linux-gnu/dist/include -I /usr/include/nspr -I /usr/include/nss -I /home/user/software/testing/icecat.loser/src/icecat-v68.3.0-gnu1/output/icecat-68.3.0/obj-x86_64-pc-linux-gnu/dist/include/nss -D MOZILLA_CLIENT -D _FORTIFY_SOURCE=2 -U _FORTIFY_SOURCE -D _FORTIFY_SOURCE=2 -U _FORTIFY_SOURCE -D _FORTIFY_SOURCE=2 -internal-isystem /usr/local/include -internal-isystem /usr/lib/clang/9.0.0/include -internal-externc-isystem /include -internal-externc-isystem /usr/include -O2 -Wall -Wbitfield-enum-conversion -Wempty-body -Wignored-qualifiers -Wpointer-arith -Wshadow-field-in-constructor-modified -Wsign-compare -Wtype-limits -Wunreachable-code -Wunreachable-code-return -Wclass-varargs -Wfloat-overflow-conversion -Wfloat-zero-conversion -Wloop-analysis -Wstring-conversion -Wtautological-overlap-compare -Wtautological-unsigned-enum-zero-compare -Wtautological-unsigned-zero-compare -Wno-error=deprecated-declarations -Wno-error=array-bounds -Wno-error=backend-plugin -Wno-error=return-std-move -Wno-error=atomic-alignment -Wformat -Wformat-security -Wno-gnu-zero-variadic-macro-arguments -std=gnu99 -fdebug-compilation-dir /home/user/software/testing/icecat.loser/src/icecat-v68.3.0-gnu1/output/icecat-68.3.0/obj-x86_64-pc-linux-gnu/build/unix/elfhack -ferror-limit 19 -fmessage-length 0 -pthread -stack-protector 2 -fobjc-runtime=gcc -fdiagnostics-show-option -fcolor-diagnostics -vectorize-loops -vectorize-slp -faddrsig -o test-array.o -x c /home/user/software/testing/icecat.loser/src/icecat-v68.3.0-gnu1/output/icecat-68.3.0/build/unix/elfhack/test-array.c

38:21.03 1. <eof> parser at end of file

38:21.03 2. Code generation

38:21.03 3. Running pass 'Function Pass Manager' on module '/home/user/software/testing/icecat.loser/src/icecat-v68.3.0-gnu1/output/icecat-68.3.0/build/unix/elfhack/test-array.c'.

38:21.03 4. Running pass 'X86 DAG->DAG Instruction Selection' on function '@test'

38:21.03 Stack dump:

38:21.04 0. Program arguments: /usr/bin/clang-9 -cc1 -triple x86_64-unknown-linux-gnu -emit-obj -disable-free -disable-llvm-verifier -discard-value-names -main-file-name test-ctors.c -mrelocation-model pic -pic-level 2 -mthread-model posix -relaxed-aliasing -masm-verbose -mconstructor-aliases -fno-plt -munwind-tables -fuse-init-array -target-cpu broadwell -dwarf-column-info -debug-info-kind=limited -dwarf-version=4 -debugger-tuning=gdb -momit-leaf-frame-pointer -ffunction-sections -fdata-sections -coverage-notes-file /home/user/software/testing/icecat.loser/src/icecat-v68.3.0-gnu1/output/icecat-68.3.0/obj-x86_64-pc-linux-gnu/build/unix/elfhack/test-ctors.gcno -resource-dir /usr/lib/clang/9.0.0 -dependency-file .deps/test-ctors.o.pp -MT test-ctors.o -sys-header-deps -MP -include /home/user/software/testing/icecat.loser/src/icecat-v68.3.0-gnu1/output/icecat-68.3.0/config/gcc_hidden.h -include /home/user/software/testing/icecat.loser/src/icecat-v68.3.0-gnu1/output/icecat-68.3.0/obj-x86_64-pc-linux-gnu/mozilla-config.h -I /home/user/software/testing/icecat.loser/src/icecat-v68.3.0-gnu1/output/icecat-68.3.0/obj-x86_64-pc-linux-gnu/dist/system_wrappers -D NDEBUG=1 -D TRIMMED=1 -I /home/user/software/testing/icecat.loser/src/icecat-v68.3.0-gnu1/output/icecat-68.3.0/build/unix/elfhack -I /home/user/software/testing/icecat.loser/src/icecat-v68.3.0-gnu1/output/icecat-68.3.0/obj-x86_64-pc-linux-gnu/build/unix/elfhack -I /home/user/software/testing/icecat.loser/src/icecat-v68.3.0-gnu1/output/icecat-68.3.0/obj-x86_64-pc-linux-gnu/dist/include -I /usr/include/nspr -I /usr/include/nss -I /home/user/software/testing/icecat.loser/src/icecat-v68.3.0-gnu1/output/icecat-68.3.0/obj-x86_64-pc-linux-gnu/dist/include/nss -D MOZILLA_CLIENT -D _FORTIFY_SOURCE=2 -U _FORTIFY_SOURCE -D _FORTIFY_SOURCE=2 -U _FORTIFY_SOURCE -D _FORTIFY_SOURCE=2 -internal-isystem /usr/local/include -internal-isystem /usr/lib/clang/9.0.0/include -internal-externc-isystem /include -internal-externc-isystem /usr/include -O2 -Wall -Wbitfield-enum-conversion -Wempty-body -Wignored-qualifiers -Wpointer-arith -Wshadow-field-in-constructor-modified -Wsign-compare -Wtype-limits -Wunreachable-code -Wunreachable-code-return -Wclass-varargs -Wfloat-overflow-conversion -Wfloat-zero-conversion -Wloop-analysis -Wstring-conversion -Wtautological-overlap-compare -Wtautological-unsigned-enum-zero-compare -Wtautological-unsigned-zero-compare -Wno-error=deprecated-declarations -Wno-error=array-bounds -Wno-error=backend-plugin -Wno-error=return-std-move -Wno-error=atomic-alignment -Wformat -Wformat-security -Wno-gnu-zero-variadic-macro-arguments -std=gnu99 -fdebug-compilation-dir /home/user/software/testing/icecat.loser/src/icecat-v68.3.0-gnu1/output/icecat-68.3.0/obj-x86_64-pc-linux-gnu/build/unix/elfhack -ferror-limit 19 -fmessage-length 0 -pthread -stack-protector 2 -fobjc-runtime=gcc -fdiagnostics-show-option -fcolor-diagnostics -vectorize-loops -vectorize-slp -faddrsig -o test-ctors.o -x c /home/user/software/testing/icecat.loser/src/icecat-v68.3.0-gnu1/output/icecat-68.3.0/build/unix/elfhack/test-ctors.c

38:21.04 1. <eof> parser at end of file

38:21.04 2. Code generation

38:21.04 3. Running pass 'Function Pass Manager' on module '/home/user/software/testing/icecat.loser/src/icecat-v68.3.0-gnu1/output/icecat-68.3.0/build/unix/elfhack/test-ctors.c'.

38:21.04 4. Running pass 'X86 DAG->DAG Instruction Selection' on function '@test'

38:21.09 #0#0 0x0000688f7938f65b0x0000602987b9f65b llvm::sys::PrintStackTrace(llvm::raw_ostream&)llvm::sys::PrintStackTrace(llvm::raw_ostream&) ((/usr/bin/../lib/libLLVM-9.so/usr/bin/../lib/libLLVM-9.so++0xb0865b)0xb0865b

38:21.09 ) 38:21.09 #1 0x0000688f7938d524#1 llvm::sys::RunSignalHandlers() 0x0000602987b9d524( /usr/bin/../lib/libLLVM-9.so+llvm::sys::RunSignalHandlers()0xb06524 )( 38:21.09 /usr/bin/../lib/libLLVM-9.so +#20xb06524 )0x0000688f7938d6b6 38:21.09 (/usr/bin/../lib/libLLVM-9.so +0xb066b6#2) 38:21.09 0x0000602987b9d6b6 #3 (0x0000688f775e6c40/usr/bin/../lib/libLLVM-9.so +__restore_rt 0xb066b6()/usr/bin/../lib/libc.so.6 38:21.09 +0x3bc40 )#3 38:21.09 0x0000602985df6c40#4 0x0000688f798ee574__restore_rt llvm::EVT::getExtendedVectorNumElements() const( (/usr/bin/../lib/libc.so.6/usr/bin/../lib/libLLVM-9.so++0x3bc400x1067574)) 38:21.09 #5#4 0x0000688f79b4e96a 0x00006029880fe574llvm::TargetLowering::SimplifyDemandedBits(llvm::SDValue, llvm::APInt const&, llvm::APInt const&, llvm::KnownBits&, llvm::TargetLowering::TargetLoweringOpt&, unsigned int, bool) const llvm::EVT::getExtendedVectorNumElements() const( /usr/bin/../lib/libLLVM-9.so(+/usr/bin/../lib/libLLVM-9.so0x12c796a)+ 38:21.09 0x1067574 )#6 38:21.09 0x0000688f79b4f2da llvm::TargetLowering::SimplifyDemandedBits(llvm::SDValue, llvm::APInt const&, llvm::APInt const&, llvm::KnownBits&, llvm::TargetLowering::TargetLoweringOpt&, unsigned int, bool) const#5 (0x000060298835e96a/usr/bin/../lib/libLLVM-9.so +0x12c82dallvm::TargetLowering::SimplifyDemandedBits(llvm::SDValue, llvm::APInt const&, llvm::APInt const&, llvm::KnownBits&, llvm::TargetLowering::TargetLoweringOpt&, unsigned int, bool) const) 38:21.09 ( /usr/bin/../lib/libLLVM-9.so#7+ 0x12c796a0x0000688f79957d1f )( 38:21.09 /usr/bin/../lib/libLLVM-9.so+ 0x10d0d1f#6) 38:21.09 0x000060298835f2da #8 llvm::TargetLowering::SimplifyDemandedBits(llvm::SDValue, llvm::APInt const&, llvm::APInt const&, llvm::KnownBits&, llvm::TargetLowering::TargetLoweringOpt&, unsigned int, bool) const0x0000688f799953ca ((/usr/bin/../lib/libLLVM-9.so/usr/bin/../lib/libLLVM-9.so++0x110e3ca0x12c82da)) 38:21.09 #9 #70x0000688f7999e088 (0x0000602988167d1f/usr/bin/../lib/libLLVM-9.so +0x1117088()/usr/bin/../lib/libLLVM-9.so 38:21.09 +#100x10d0d1f 0x0000688f7999f76f) 38:21.09 (/usr/bin/../lib/libLLVM-9.so +#80x111876f )0x00006029881a53ca 38:21.09 #11( /usr/bin/../lib/libLLVM-9.so0x0000688f799a11be+ 0x110e3callvm::SelectionDAG::Combine(llvm::CombineLevel, llvm::AAResults, llvm::CodeGenOpt::Level)) 38:21.09 (/usr/bin/../lib/libLLVM-9.so+ 0x111a1be#9) 38:21.09 0x00006029881ae088#12 (0x0000688f79b2dab0/usr/bin/../lib/libLLVM-9.so +llvm::SelectionDAGISel::CodeGenAndEmitDAG() 0x1117088()/usr/bin/../lib/libLLVM-9.so 38:21.09 +0x12a6ab0#10) 38:21.09 0x00006029881af76f#13 0x0000688f79b322e2( llvm::SelectionDAGISel::SelectAllBasicBlocks(llvm::Function const&)/usr/bin/../lib/libLLVM-9.so +(0x111876f/usr/bin/../lib/libLLVM-9.so)+ 38:21.09 0x12ab2e2) 38:21.09 #11#14 0x00006029881b11be0x0000688f79b350be llvm::SelectionDAG::Combine(llvm::CombineLevel, llvm::AAResults, llvm::CodeGenOpt::Level)( /usr/bin/../lib/libLLVM-9.so+(0x12ae0be/usr/bin/../lib/libLLVM-9.so)+ 38:21.09 0x111a1be#15) 38:21.09 0x0000688f7b9b0e5a (#12/usr/bin/../lib/libLLVM-9.so +0x3129e5a0x000060298833dab0) 38:21.09 llvm::SelectionDAGISel::CodeGenAndEmitDAG()#16 0x0000688f796df2ad( llvm::MachineFunctionPass::runOnFunction(llvm::Function&)/usr/bin/../lib/libLLVM-9.so +(/usr/bin/../lib/libLLVM-9.so0x12a6ab0+)0xe582ad 38:21.09 ) 38:21.10 #13#17 0x00006029883422e20x0000688f794ae578 llvm::FPPassManager::runOnFunction(llvm::Function&)llvm::SelectionDAGISel::SelectAllBasicBlocks(llvm::Function const&) ((/usr/bin/../lib/libLLVM-9.so+/usr/bin/../lib/libLLVM-9.so0xc27578+)0x12ab2e2 38:21.10 )#18 38:21.10 0x0000688f794ae5f2#14 llvm::FPPassManager::runOnModule(llvm::Module&) 0x00006029883450be( /usr/bin/../lib/libLLVM-9.so+(0xc275f2/usr/bin/../lib/libLLVM-9.so)+ 38:21.10 0x12ae0be#19) 0x0000688f794ad87d 38:21.10 llvm::legacy::PassManagerImpl::run(llvm::Module&)#15 (/usr/bin/../lib/libLLVM-9.so0x000060298a1c0e5a+ 0xc2687d()/usr/bin/../lib/libLLVM-9.so 38:21.10 +#200x3129e5a 0x0000688f77faa502) 38:21.10 clang::EmitBackendOutput(clang::DiagnosticsEngine&, clang::HeaderSearchOptions const&, clang::CodeGenOptions const&, clang::TargetOptions const&, clang::LangOptions const&, llvm::DataLayout const&, llvm::Module, clang::BackendAction, std::unique_ptr<llvm::raw_pwrite_stream, std::default_delete<llvm::raw_pwrite_stream> >)#16 (0x0000602987eef2ad/usr/bin/../lib/libclangCodeGen.so.9 +0xc5502llvm::MachineFunctionPass::runOnFunction(llvm::Function&)) 38:21.10 (/usr/bin/../lib/libLLVM-9.so+0xe582ad) 38:21.10 #17 0x0000602987cbe578 llvm::FPPassManager::runOnFunction(llvm::Function&) (/usr/bin/../lib/libLLVM-9.so+0xc27578) 38:21.10 #18 0x0000602987cbe5f2 llvm::FPPassManager::runOnModule(llvm::Module&) (/usr/bin/../lib/libLLVM-9.so+0xc275f2) 38:21.10 #19 0x0000602987cbd87d llvm::legacy::PassManagerImpl::run(llvm::Module&) (/usr/bin/../lib/libLLVM-9.so+0xc2687d) 38:21.10 #20 0x00006029867ba502 clang::EmitBackendOutput(clang::DiagnosticsEngine&, clang::HeaderSearchOptions const&, clang::CodeGenOptions const&, clang::TargetOptions const&, clang::LangOptions const&, llvm::DataLayout const&, llvm::Module, clang::BackendAction, std::unique_ptr<llvm::raw_pwrite_stream, std::default_delete<llvm::raw_pwrite_stream> >) (/usr/bin/../lib/libclangCodeGen.so.9+0xc5502) 38:21.34 clang-9: error: unable to execute command: Segmentation fault (core dumped) 38:21.34 clang-9: error: clang frontend command failed due to signal (use -v to see invocation) 38:21.34 clang version 9.0.0 (tags/RELEASE_900/final) 38:21.34 Target: x86_64-unknown-linux-gnu 38:21.34 Thread model: posix 38:21.34 InstalledDir: /usr/bin 38:21.34 clang-9: note: diagnostic msg: PLEASE submit a bug report to and include the crash backtrace, preprocessed source, and associated run script. 38:21.35 clang-9: error: unable to execute command: Segmentation fault (core dumped) 38:21.35 clang-9: error: clang frontend command failed due to signal (use -v to see invocation) 38:21.35 clang version 9.0.0 (tags/RELEASE_900/final) 38:21.35 Target: x86_64-unknown-linux-gnu 38:21.35 Thread model: posix 38:21.35 InstalledDir: /usr/bin 38:21.35 clang-9: note: diagnostic msg: PLEASE submit a bug report to and include the crash backtrace, preprocessed source, and associated run script. 38:21.39 clang-9: note: diagnostic msg: 38:21.39 **** 38:21.39 PLEASE ATTACH THE FOLLOWING FILES TO THE BUG REPORT: 38:21.39 Preprocessed source(s) and associated run script(s) are located at: 38:21.39 clang-9: note: diagnostic msg: /tmp/test-ctors-d67cfe.c 38:21.39 clang-9: note: diagnostic msg: /tmp/test-ctors-d67cfe.sh 38:21.39 clang-9: note: diagnostic msg: 38:21.40 *** 38:21.40 make[4]: [/home/user/software/testing/icecat.loser/src/icecat-v68.3.0-gnu1/output/icecat-68.3.0/config/rules.mk:755: test-ctors.o] Error 254 38:21.40 make[4]: Waiting for unfinished jobs.... 38:21.41 clang-9: note: diagnostic msg: 38:21.41 ** 38:21.41 PLEASE ATTACH THE FOLLOWING FILES TO THE BUG REPORT: 38:21.41 Preprocessed source(s) and associated run script(s) are located at: 38:21.42 clang-9: note: diagnostic msg: /tmp/test-array-1deb9c.c 38:21.42 clang-9: note: diagnostic msg: /tmp/test-array-1deb9c.sh 38:21.42 clang-9: note: diagnostic msg: 38:21.42 ** 38:21.42 make[4]: [/home/user/software/testing/icecat.loser/src/icecat-v68.3.0-gnu1/output/icecat-68.3.0/config/rules.mk:755: test-array.o] Error 254 38:21.42 make[3]: [/home/user/software/testing/icecat.loser/src/icecat-v68.3.0-gnu1/output/icecat-68.3.0/config/recurse.mk:101: build/unix/elfhack/libs] Error 2 38:21.42 make[2]: [/home/user/software/testing/icecat.loser/src/icecat-v68.3.0-gnu1/output/icecat-68.3.0/config/recurse.mk:34: libs] Error 2 38:21.42 make[1]: [/home/user/software/testing/icecat.loser/src/icecat-v68.3.0-gnu1/output/icecat-68.3.0/config/rules.mk:413: default] Error 2 38:21.42 make: [client.mk:125: build] Error 2 38:21.47 159 compiler warnings present. 38:21.59 /usr/bin/notify-send --app-name=Mozilla Build System Mozilla Build System Build failed ==> ERROR: A failure occurred in build(). Aborting...

I didn't feel like pressing enter after each line anymore so the post is kinda whatever like waiting for over 10gb of data to download for this shit and then it fails with something as fucking stupid as this. Many are experiencing this, guess amateur hour is back for season 4.

Cant build because sha256sums check fails at icecat-master.tar.gz

I had to push a new release, because new rust version breaks IceCat build.

Changelog:

• I have switched to Antonio Trande's repo as main source. No more big patch files...
• New AUR dependency rust-bin=1.37.0 (yeah, it's not the best option, but Rust 1.39 is not supported in Mozilla ESR branch)

If anybody wants to build in a clean chroot, I managed to build using clean-chroot-manager by graysky adding rust-bin to local repo then build it.

OK got the key on another machine without proxy and installed manually ;-) Works fine, thanks!

Please, resync your local repos. Just pushed a commit to fix dependencies.

Also for @jaro3 uncomment line 53 (# sed -e 's/^gpg2 --keyserver.*//g' -i makeicecat) to avoid checking gpg2.