I know the OP is talking about leveraging the video acceleration, so I wanted to throw in a few of my experiences...
For a faster desktop experience (which is not what I understand is the focus of Armbian) you want to install the fbturbo_drv Xorg driver. Instructions for that can be found here: http://linux-sunxi.org/Xorg
This works with or without the Cedar and MALI drivers. Typical desktops used on ARM platforms don't use compositing and therefore get no real boost from these drivers. the Cedar (vdpau) driver is the one for accelerated video playback. It uses the NEON functions. There's a great writeup here: http://www.cnx-software.com/2013/12/10/most-embedded-gpus-do-not-support-hardware-video-decoding-acceleration-the-vpu-does/
I was recently *chastised* by one of the authors of the lima driver, which is reverse engineering of the ARM MALI binary blob, for asking for video acceleration via the MALI subsystem...
I've used the guides here: https://archlinuxarm.org/forum/viewtopic.php?f=33&t=5979 and here: https://blog.eldajani.net/banana-pi-arch-linux-accelerated-mali-gpu/ to get both Cedar and Mali to work. The caveat is that both of these methods rely on vendor provided proprietary binary blobs that are only compatible with the 3.4 kernel...
I've found the same issues that RagnerBG pointed out regarding mplayer having the vdpau components not compiled in the repository. The steps outlined in the previous post work for me as well.
Anyway, apologies for the rambling.. good day all!