Package Details: hadoop 3.4.1-1

Git Clone URL: https://aur.archlinux.org/hadoop.git (read-only, click to copy)
Package Base: hadoop
Description: An open-source software for reliable, scalable, distributed computing
Upstream URL: https://hadoop.apache.org/
Keywords: apache big-data java map-reduce
Licenses: Apache
Conflicts: yarn
Submitter: sjakub
Maintainer: matthewq337
Last Packager: matthewq337
Votes: 85
Popularity: 0.24
First Submitted: 2009-04-07 16:39 (UTC)
Last Updated: 2024-11-11 04:00 (UTC)

Dependencies (10)

Required by (3)

Sources (8)

Latest Comments

« First ‹ Previous 1 2 3 4 5 6 7 8 Next › Last »

petronny commented on 2022-08-24 12:23 (UTC)

Getting the following error:

[INFO] Finished at: 2022-08-23T03:06:07Z
[INFO] ------------------------------------------------------------------------
Error:  Failed to execute goal org.apache.hadoop:hadoop-maven-plugins:3.3.4:cmake-compile (cmake-compile) on project hadoop-common: CMake failed with error code 1 -> [Help 1]
Error:  
Error:  To see the full stack trace of the errors, re-run Maven with the -e switch.
Error:  Re-run Maven using the -X switch to enable full debug logging.
Error:  
Error:  For more information about the errors and possible solutions, please read the following articles:
Error:  [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
Error:  
Error:  After correcting the problems, you can resume the build with the command
Error:    mvn <args> -rf :hadoop-common
==> ERROR: A failure occurred in build().

Full build log: https://github.com/arch4edu/cactus/runs/7965119458?check_suite_focus=true

And you can always find the new build log of this package at https://arch4edu.github.io/

ttc0419 commented on 2022-08-21 16:37 (UTC)

@gnaggnoyil Thanks for the report, please uninstall all idk/jre packages and build it again. If you still encounter errors, please paste the log in the comment. As for the conflict, I'll update it together with the fix for the issue above.

gnaggnoyil commented on 2022-08-21 14:25 (UTC) (edited on 2022-08-21 14:33 (UTC) by gnaggnoyil)

@galaxy0419 Hi, I've encountered errors in build() and I found that I have to use JAVA_HOME=/usr/lib/jvm/default makepkg -s to have this package successfully built. Is this due to that I'm missing something or just that the PKGBUILD needs to be fixed?

Also, the created package have conflict files with community/yarn on file /usr/bin/yarn. Please resolve this conflict.

ttc0419 commented on 2022-07-31 13:01 (UTC) (edited on 2022-07-31 13:01 (UTC) by ttc0419)

@severach Hi, package without bin suffix should be built from source, I'm happy to provide a PKGBUILD to build hadoop from scratch. Could you make me as the maintainer?

severach commented on 2022-04-20 16:06 (UTC)

I don't use hadoop so I can't help make it better. I only grabbed it because at one time there was a threat that orphaned packages would get deleted. Become a co-maintainer or take the package.

gnaggnoyil commented on 2022-04-19 15:05 (UTC)

I agree with @siavoshkc that the current behavior of usr/bin/hadoop directly sourcing /etc/profile.d/*.sh does not fit Archlinux well. I think AUR/hadoop should therefore do some patches to eliminate possible errors.

lllf commented on 2021-05-05 01:53 (UTC) 

ERROR: Failure while downloading  
http://mirror.reverse.net/pub/apache/hadoop/common/hadoop-3.3.0/hadoop-3.3.0.tar.gz

URL no longer exists.

sicalxy commented on 2021-04-22 16:42 (UTC) (edited on 2021-04-22 16:44 (UTC) by sicalxy)

[hadoop-conf]: EnvironmentFile for *.service doesn't work

EnvironmentFile should not use source . /etc/profile.d/hadoop.sh. It's just a key-value text file (although it has some shell script features), as mentioned in man page [systemd.exec(5)]:

The text file should contain new-line-separated variable assignments. Empty lines, lines without an "=" separator, or lines starting with ; or # will be ignored

sicalxy commented on 2021-04-22 16:41 (UTC)

[hadoop-profile]: old option should be updated

- export HADOOP_SLAVES=/etc/hadoop/slaves
+ export HADOOP_WORKERS=/etc/hadoop/workers

siavoshkc commented on 2021-01-22 19:26 (UTC)

There seems to be a bug in PKGBUILD and consequently in /usr/bin/hadoop.

When a .sh is placed in /etc/profile.d, /etc/profile should be sourced to put .sh files in /etc/profile.d in effect.

In current hadoop 3.3.0-1, there is a loop that tries to source each .sh file in profile.d directory. Because the structure of files in profile.d are dependent on the /etc/profile script, that leads to error such as 'append_path: Command not found'.

Resolution: Change the loop which starts at line 111 and ends in 113 to: . /etc/profile

« First ‹ Previous 1 2 3 4 5 6 7 8 Next › Last »