Failure to fail
The following scripts demonstrate a failure to fail when executed on a hadoop cluster (fails fine if executed locally).
The test uses dumbo.sumsreducer where dumbo.sumreduce should be used. A TypeError should be thrown by dumbo.sumsreducer (in the combiner). Instead the Hadoop reports show no error and zero output from the mapper.
Run the test: "python run.py"
The test uses dumbo.sumsreducer where dumbo.sumreduce should be used. A TypeError should be thrown by dumbo.sumsreducer (in the combiner). Instead the Hadoop reports show no error and zero output from the mapper.
Run the test: "python run.py"
Leave a comment