The minister confirmed to BNS that he signed on Wednesday a decree to dismiss Caplinskas from the post, which he has held since 1989, based on the findings of an official investigation.
"He is being dismissed because of a number of violations of work discipline and failure to perform his duties," Veryga told the parliament.
The minister said the decision to fire Caplinskas had nothing to do with his running for parliament in the recent election on the Social Democratic Party's list.
"A commission was formed and (found that) some of those violations were committed long before he stood as a candidate in the election or said which party he was running with," Veryga said.
"His failure to perform his duties is the sole reason," he added.
Caplinskas is currently on a sick leave, but when he is back in office, it will be his last day in the post, according to the minister.