My findings with LM317 is that it will provide constant current only under the condition that a constant voltage is supplied. Meaning it will need at least 3V for itself to work properly, otherwise the constant current will drop gradually along with the decreasing battery voltage.
You will need...