I will give a detailed overview of the many structures and algorithms in the Magma Computer Algebra system for computing in Linear and Polynomial Algebra. The key challenges and successes will be highlighted, particularly in the goal of practical implementations of asymptotically-fast algorithms.