Programmable real-time audio signal processing application
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

notes.txt 8.5KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215
  1. CONTENTS:
  2. 1) TODO List
  3. 2) OSX Install Notes
  4. STRATEGY
  5. + implement highly parallel version - which can take advantage of multiple processors
  6. to do more - acoustic pitch tracking, source separation based fades
  7. TODO:
  8. + When a cmMsgList item is selected it should send out the selected index
  9. after the individual data items rather than before them - this way the index
  10. can be used as a definitive signal to perform some action on the previously
  11. transmitted data items.
  12. + cmJson and cmLex should report the name of the file when with syntax error messages.
  13. + Use CSV for mod score file format (to eliminate need for labels)
  14. + Autoload of default pgm cfg, program, enable audio, sequence, score location.
  15. + Circuit switcher patch.
  16. + Review and document the app threading and locking during audio file loading.
  17. + Remove old performance evaluation code from cmScore.
  18. + All programs should be able to reload without crashing via enabling/disabling audio.
  19. + Select and save audio devices.
  20. + (done) Mac Conversion
  21. + (done) Live MIDI - to test audio/MIDI delay.
  22. + (done) As threshold increases overall volume decreases - add a compensation algorithm.
  23. + There are unintialized variable warnings on the release build.
  24. + Add preset delete.
  25. + All uses of va_copy() should have a complimentary va_end()
  26. *** 9/27
  27. * Implement live recording for use in part 2.
  28. * Implement a delay between when a new section is set to trigger and when
  29. it actually does. This might allow transitions to be set up prior to when they are heard.
  30. * OS-X version crashes when the printf("PROCSET ...) is removed from _cmScProcSets().
  31. * Add ability to set mappings and perf. measure settings to scMod.
  32. * The scMod should play through all changes up to the cur starting location so that
  33. we can mimic the state of playing the piece through but allow starting from any location.
  34. * Experiment with changing settings using the scMod ramping functions.
  35. * Make a source separation based fade using an filter/inverse filter based on the
  36. spectrum prior to the cross-fade. As an extra feature notice the state of the pedal
  37. and decay appropriately.
  38. * The 'cost' value is not correct - it is being displayed as the same as the related attribute.
  39. * Setting the upper slope to a negative value is effective.
  40. * Demo Material: Seq 8 Mark 204 (1024-4 2048-4) Fade 10ms Cost->Threshold.
  41. - recd7 Mark 151
  42. - recd8 Mark 145 - same settings a previous take.
  43. - recd9 Mark 145 - w/ changing xfade switch to mode 4 at 38
  44. - recd10 Mark 145 - same w/ no mode change
  45. - recd11 Mark 145 - 3 different takes w/ score constant - no perf. parameters used - fixed threshold=65
  46. - recd12 Mark 148 (same settings as recd9)
  47. - recd13 Mark 151
  48. - recd14 Mark 161 Section 40 - fixed changes see mod0.js for note
  49. *** 8/13
  50. * Cross-fade was cutting out during demo.
  51. * Missing takes between seq 7 and seq 8.
  52. * The MIDI is mis-aligned against the audio.
  53. * Are cost / tempo working? ... test changing mode.
  54. * Add an automatic volume adjustment to prevent parameter changes from causing large volume changes.
  55. * What can we actually do between after a MIDI note is received? Is it already too late to
  56. send parameters w/o affecting the attack of the note.
  57. * Live Test material
  58. Part 1: Meas:76 - (one measure) to get measurments for later sections
  59. Part 1: Meas:94 (sect 38) through Meas:136 (include 136 stop at 137).
  60. Part 2: ("/Users/kevin/temp/piano score part 2 draft 1 master m 232 - 241 1st 2 bts.sib")
  61. The downbeat of part two aligns with the 3rd beat (in 4/4) of 122 in the first part.
  62. Ends on measure 131 at end of beat 3.
  63. MISSING MIDI for 114:126
  64. *** July 10
  65. ** (done) Make separate mappings and scale/range controls for left and right.
  66. ** Add EQ output stage.
  67. ** Work out the speaker setup.
  68. ** Add capture/playback. Analyze notes on capture and do not play if there are
  69. any wrong notes. (Skipped notes however are acceptable.)
  70. **
  71. ** When a section transition is occurs late - (e.g. due to dropped notes) do not apply
  72. the transformation all at once - instead either ramp it in or step it in on subsequent
  73. attacks. Section transitions which are positively identified are intended to have
  74. dramatic changes so applying the updated parameters immediately is acceptable - but
  75. when the parameters are changed mid-section they should be much applied subtely.
  76. ** (done) Build a database of measurements and setup the program to be able to
  77. apply a given measurement at it's assigned section.
  78. ** Redevelop spectral distortion algorithm to use a spline as the transform.
  79. ** use Log frequency frequency transform instead of FFT.
  80. ** Allow for a continous window size via zero padding.
  81. ** Add a 'write' preset file button - so the preset file can be saved prior to next crash.
  82. ** measurement values can generate MAX_DBL - be sure that are not being sent through to the audio algorithm.
  83. (see ln:965 cmDspKr.c for a hack to fix this)
  84. ** add invert to scale/range to cause output to go in opposite direction.
  85. ** non-grace eveneess are used to generate a measurement value from previous tempo calibration section.
  86. (non-grace evenness notes therefore have two scores: 'evenness' and 'overall-duration').
  87. ** note that the default setting for dyn and even.
  88. ** add dyn,even,tempo,cost number boxes to allow artificial setting of these parameters.
  89. add dyn,even,tempo,cost as modulator variables to allow them to be set from the modulator
  90. With these additions we can simulate apply measurements at the 'application' section.
  91. ** add begining and ending measure numbers to 'seq' labels
  92. ** Gain compensation for mode 4.
  93. ** Do IFFT using cos()^c + i * sin()^c - these bases are orthognal but cause harmonic distortion.
  94. To be efficient this might involve writing an FFT function.
  95. // May 22
  96. ** Crashers (Should be tested but are probably already fixed following score follower debugging.)
  97. Seq 2 m24 Mark 36 & 38
  98. Seq 4: Mark 115
  99. Seq 4: m76-79 Mark 129 (W/ meas: even & dyn -> thresh change min Thresh to 40) - use 4th seq w/ b1
  100. Seq 6: m92 Mark 143
  101. Seq 7: m103 Mark 173
  102. Seq 7: Mark 172 Meas 103 - always crashes on playback.
  103. Seq 4: Mark 76 Meas 40 - crash!
  104. Seq 2: First mark meas 23
  105. Crash seems to happen in cmProc4.c: _cmScMatchInitMtx() ln:1311.
  106. It looks like a memory overrun. Looks like the first line is wrong
  107. shouldn't:
  108. if( rn >p->mrn && cn > p->mcn )
  109. be
  110. if(rn*cn > p->mrn*p->mcn)
  111. BUGS:
  112. // Apr 20
  113. The tempo measurement can produce invalid values. Set score to 22 then play Mark 38.
  114. First tempo measurement is a non-sense value - probably produced by an div by zero.
  115. Also: Mark 8, Meas 10.
  116. Crash on playing Mark 37.
  117. Click on list control outside below list item - crash!
  118. Select Mark 171 (Seq 7) Section 43, m103 crash
  119. // Feb 27
  120. + Audio seems to preceded MIDI by around 250ms this probably arises
  121. from a delay that was inserted by 'mas'. Can the delay be removed?
  122. // Feb 25
  123. + Fix the audio file input/output ports
  124. //
  125. // Feb 6 & 7
  126. //
  127. + Performed notes which arrive which about 50ms could be
  128. considered chords. Extra notes notes which were not part of
  129. the chord are probably common and should be discounted during
  130. the cost analysis.
  131. + (done) Add alignment cost as a 4th variable along with dyn,even,tempo.
  132. + (done) In the score print out (score_loc.txt) Section 2 is starting on Bar 5
  133. when it should start inside Bar 7.
  134. + In Take 1 the 2nd dynamics set is not triggered.
  135. + In Take 3 Eveness 2 the C2 and F#4 are NOT missing althrough they are in the
  136. evalation. Also E7 which ends that set is not marked with an 'e'.
  137. + It is possible to have even-non-grace sets where the note rythm value's are not
  138. all the same (e.g. bar 20 )
  139. + User soft-thresholds for the dynamics categories.
  140. + Set 39 even measure 25 shows the first note as G#2 when it should be C#1
  141. + Missig MIDI note sounded:
  142. C1 score-loc:132
  143. A#2 140
  144. A5 173
  145. C#2 195 Marker 36
  146. E5,G33,A#2,C#1 212-218 Marker 36
  147. E3 185 Marker 37
  148. F5,C#4,G#5 986 Marker 204
  149. -------------------------------------------------------------------------------
  150. OSX - Install Notes
  151. -------------------------------------------------------------------------------
  152. 1. Install macports
  153. 2. Install git-core (sudo port install git-core)
  154. 3. sudo port install fftw-3
  155. 4. sudo port install fftw-3--single
  156. 5. port select --list gcc (which gcc is active)
  157. 6. sudo port install gcc47
  158. 7. sudo port --set gcc mp-gcc47
  159. 8. sudo port install fltk
  160. 9. sudo port install xorg-libX11
  161. 10 install ~/Library/Preferences/org.larke.kc.txt (is this required?)
  162. 11 create ~/Library/Preferences/kc
  163. 12 Install ~/Library/Preferences/time_line.js, time_line_preset.js, time_line_preset.csv