As my partner Harry pointed out when I suggested light armor perks, this build is really about heavy offense rather than defense. We prioritized quick, hard hitting attacks (either in Sneak or with the Slow-Time shout), with movement and block as our main defense, (plus the Absorb Health enchants on weapons). You may find your character skills a little bit too spread-out if you add light armor perks.
As my partner Harry pointed out when I suggested light armor perks, this build is really about heavy offense rather than defense. We prioritized quick, hard hitting attacks (either in Sneak or with the Slow-Time shout), with movement and block as our main defense, (plus the Absorb Health enchants on weapons). You may find your character skills a little bit too spread-out if you add light armor perks.