Troubleshooting
Following are common errors/warnings generated by the toolkit operators with proposed fix actions.
| Error Type | Error Code | Error Message | Proposed Fix Actions |
|---|---|---|---|
| Connection Error | CDIST3366E | Failed to connect to Cloud Object Storage endpoint: ‘‘{0}’’. | Check COS connection credentials and endpoint |
| “Early” close warning | CDIST3371W | Object ‘‘{0}’’ closed before rolling policy expiration. | Increase operator heap size using vmArg param |
| Max number of active objects threshold reached | CDIST3372W | Number of active objects (partitions) ‘‘{0}’’ exceeds cache limit ‘‘{1}’’ | See Preferred practices for partitions design |
| Write Object Error | CDIST3373E | Failed to write object ‘‘{0}{1}’’: ‘‘{2}’’ | The specific client error message might be helpful for an error root cause analysis |
| Close Object Error | CDIST3374E | Failed to close object ‘‘{0}{1}’’: ‘‘{2}’’ | The specific client error message might be helpful for an error root cause analysis |
Note, that for error codes CDIST3373E and CDIST3374E the detailed low-level error message for s3a protocol is
generated by amazon client (utilized by hadoop-aws library).
Use the Amazon Client Error Responses table for further details.