This contains both the matrix number and key position, in preparation for multi-matrix support
Also change the internal representation to a one dimensional array