{"id":3583,"date":"2024-08-30T17:06:16","date_gmt":"2024-08-30T21:06:16","guid":{"rendered":"https:\/\/www.yorku.ca\/professor\/drsmith\/?p=3583"},"modified":"2024-08-30T17:17:00","modified_gmt":"2024-08-30T21:17:00","slug":"vpl-risc-v-simulation-with-kite-with-random-registers","status":"publish","type":"post","link":"https:\/\/www.yorku.ca\/professor\/drsmith\/2024\/08\/30\/vpl-risc-v-simulation-with-kite-with-random-registers\/","title":{"rendered":"VPL & RISC-V Simulation with Kite (with random registers)"},"content":{"rendered":"
\n
\"Screenshot
Screenshot of VPL exercise that uses the Kite RISC-V simulator to make a negative integer positive by applying both xori and addi operations.<\/figcaption><\/figure>\n<\/div>\n\n\n

In another post, I set up a basic Virtual Programming Lab exercise for RISC-V simulations with Assembler coding and the Kite simulator. That example is vulnerable to students hard-coding the register values without actually writing the necessary code. But I wrote it in order to provide a solid first example.<\/p>\n\n\n\n

Here, we're going to write an exercise in VPL that is harder to fool. We'll do two things to accomplish this. We will...<\/p>\n\n\n\n

    \n
  1. Initialize all register values to random values, and<\/li>\n\n\n\n
  2. Allow for specific registers to have specific initial values.<\/li>\n<\/ol>\n\n\n\n

    (In a future blog post I'll deal with running the simulation multiple times, each time with a different set of randomized register values.)<\/em><\/p>\n\n\n\n

    This works because of two important elements:<\/p>\n\n\n\n

      \n
    1. The VPL system typically relies on two bash shell scripts to work: vpl_run.sh and vpl_evaluate.sh.<\/li>\n\n\n\n
    2. The Kite simulator loads a pair of text files when it starts up. The first file provides the starting state of the registers and the second file provides the starting state of a bank of memory. (reg_state and mem_state, respectively)<\/li>\n<\/ol>\n\n\n\n

      So, we'll create a bash script that will initialize that register file to random values. Now, I'm not a bash scripting person, so I turned to Bing to help me out. Here is the basic code for generating 30 registers (x0 to x29). I'll modify this later to permit all 32 registers within vpl_run.sh and vpl_evaluate.sh.<\/p>\n\n\n\n

      # File created with Bing\/ChatGPT\n<\/mark>#!\/bin\/bash\n<\/mark>\n# Define the output file. (the register state file, reg_state)\n<\/mark>output_file=\"reg_state\"\n\n# Define an associative array for specific values\n<\/mark>declare -A specific_values\n\n# Example of setting specific values (uncomment and modify as needed)\n# specific_values[5]=12345  # Assign 12345 to the 6th line (index 5)<\/em>\n# specific_values[10]=54321 # Assign 54321 to the 11th line (index 10)<\/em><\/mark>\n\n# Function to generate a random 16-bit integer\n<\/mark>generate_random_16bit() {\n    echo $((RANDOM % 32768))\n}\n\n# Create or clear the output file\n<\/mark>> \"$output_file\"\n\n# Loop to create 30 lines\n<\/mark>for i in {0..29}; do\n    if [[ -n \"${specific_values[$i]}\" ]]; then\n        value=\"${specific_values[$i]}\"\n    else\n        value=$(generate_random_16bit)\n    fi\n    echo \"x$i = $value\" >> \"$output_file\"\ndone\n\necho \"File created: $output_file\"<\/code><\/pre>\n\n\n\n
      This code will generate a file called file.txt with 30 lines in it.  Each line will be of the form A = B, where A is a value like x0, x1, x2, etc. and B  will be some random value.  Now, there are situations where an instructor might want to hard code a register value. The instructor can then write something like specific_values[5]=12345<\/em><\/mark> to set register x5 to 12345.<\/p>\n\n\n\n
      \n\n\n\n
      Here's a student problem:<\/p>\n\n\n\n
      Student task:  Take the negative value found in register x6, invert all the bits in register x6  and then add one to the answer.  Store that final value in x5.<\/p>\n\n\n\n
      (this is a variation of existing lab problem, aex3a: \" Convert -5 to +5 by negating its bits and adding 1. Save your solution as a file named aex3a.asm for possible future use.\"<\/p>\n\n\n\n
      You code up the secret<\/em> teacher solution as this:<\/p>\n\n\n\n
      xori x7, x6, -1\naddi x5, x7, 1<\/code><\/pre>\n\n\n\n
      Call this file teacherAssemblerSolution.asm and upload it to the Executable Files section of the VPL exercise.<\/p>\n\n\n\n
      Now, in VPL, we need to set the vpl_run.sh<\/strong> file:<\/p>\n\n\n\n
      #!\/bin\/bash\n#\n# vpl_run.sh<\/strong> script (KITE RISCV version)\n<\/mark># The output of the student program is tested against the expected output file.\n# \n# James Andrew Smith; drsmith@yorku.ca August 30, 2024.\n#\n# Based on example by D. Thiebaut at Smith College\n# http:\/\/www.science.smith.edu\/dftwiki\/index.php\/Tutorial:_Moodle_VPL_--_Testing_a_C_Program\n# and\n# https:\/\/www.mapleprimes.com\/posts\/38232-Scripting-With-Maple\n#\n# Modified for Maple and described here: https:\/\/www.yorku.ca\/professor\/drsmith\/2021\/08\/01\/vpl-using-maple-for-math-assignments\/\n#\n# Updated in August 2024 for Kite simulation and RISC-V.\n# A small section of this used Bing\/ChatGPT to generate random values for the registers.\n# -----------------------------------------------------------------\n\n\ncat > vpl_execution <<EEOOFF\n#!\/bin\/bash\n\n# Variables (make changes here)\nteacherSolution=teacherAssemblerSolution.asm\nstudentProgram=StudentSubmission.asm\nmaxGrade=1\nminGrade=0\nconsolationGrade=0\ninit_register_file=\"reg_state\"\n\n# --- randomize the register state file, reg_state ------\n# this section of the bash script was generated used Bing\/ChatGPT\n# vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv\n\n# Generate an array of 32 random 16-bit unsigned integers\ndeclare -a arr\nfor i in {0..31}; do\n    arr[i]=\\$((RANDOM % 65536))\ndone\n\n# Override specific elements with constant values (example: arr[0] = 1234, arr[15] = -5678)\narr[0]=1234                                 # x1 is fixed to 1234\narr[15]=-5678                               # x15 is fixed to -5678\narr[6]=\\$(( \\$RANDOM - 32768 ))             # x6 is a random negative number.\n\n# Create the string with 32 lines in the form A = B\noutput=\"\"\nfor i in {0..31}; do\n  output+=\"x\\$i = \\${arr[i]}\\n\"\ndone\n# ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n# -------------------------------------------------------------------\n\n\n# --- create test (Teacher Solution) ---\n# Write the string to reg_state.txt. (to initialise registers)\necho -e \"\\$output\" > \"\\$init_register_file\"\n\n# run Kite on the teacher solution.  Output to solution.txt.  Extra text to \/dev\/null\necho \"running KITE on teacher solution...\"\n\/eecs\/local\/pkg\/kite\/bin\/kite \\${teacherSolution} > solutionTemp.txt\n\n# erase all lines prior to the string\nsed -i '1,\/Register state:\/d' solutionTemp.txt\n\n# erase all lines at the end of the file after \"elapsed\":\nsed -n '\/elapsed\/q;p' solutionTemp.txt > solution.txt\n\n# Default grade is zero.\ngrade=\\$minGrade\n\nfor i in 1 ; do\n   echo \"TEST \\$i\"\n\n   # ==============================================\n   # TEST i\n   # ==============================================\n\n   # Write the string to reg_state.txt. (to initialise registers)\necho -e \"\\$output\" > \"\\$init_register_file\"\n\n\n   echo \"Running KITE on the student solution...\"\n\n\/eecs\/local\/pkg\/kite\/bin\/kite \\${studentProgram} > userTemp.out\n\n# erase all lines prior to the string\nsed -i '1,\/Register state:\/d' userTemp.out\n\n# erase all lines at the end of the file after \"elapsed\":\nsed -n '\/elapsed\/q;p' userTemp.out > user.out\n\n   # all processing of whitespace to remove it has been, itself removed.\n   # want to see how that's done?  Go to \n   # http:\/\/www.science.smith.edu\/dftwiki\/index.php\/Tutorial:_Moodle_VPL_--_Testing_a_C_Program\n   \n   #--- compute difference, with exact whitespace --- \n   diff -y user.out solution.txt > diff.out\n   \n   # debug:\n #    echo \"----- diff.out ------\"\n #   cat diff.out\n #   echo \"---------------------\"\n\n   \n   #--- reject if different ---\n   if ((\\$? > 0)); then\n      echo \"Your output is NOT correct.\"\n\n\n      echo \"---------------\"\n      echo \"Your output:\"\n      echo \"---------------\"\n      cat user.out\n      \n      echo \"\"\n      echo \"---------------\"\n      echo \"Expected output  \"\n      echo \"---------------\"\n      cat solution.txt\n\n      grade=\\$( expr \\$minGrade )\n   \n      #--- consolation grade (\"thanks for coming out\")---   \n      #grade=\\$( expr \\$consolationGrade )\n\n      # --------------------- REWARD IF CORRECT OUTPUT -----------------\n   else\n      #--- good output ---\n      echo \"Congrats, your output is correct.\"\n      echo \" --------------------------------\"\n      cat user.out\n      echo \"--------------------------------\"\n      grade=\\$( expr \\$maxGrade )\n   fi\ndone\n\n# Uncomment this for the vpl_run.sh\n# Comment it for vpl_evaluate.sh\n<\/mark>echo \"Possible Grade : \\$grade (you need to evaluate for official grade)\"<\/mark>\n<\/strong>\n# Uncomment this for vpl_evaluate.sh.  Otherwise comment it.\n#echo \"The following grade is being sent to eClass: \\$grade\"\n#echo \"Grade :=>> \\$grade\"<\/strong><\/mark>\n\nexit 0\nEEOOFF\n\n \nchmod +x vpl_execution\nexit 0<\/code><\/pre>\n\n\n\n
      We also need to define the vpl_evaluation.sh<\/strong> script:<\/p>\n\n\n\n
      #!\/bin\/bash\n#\n# vpl_evaluate<\/strong> script (KITE RISCV version)\n<\/mark># The output of the student program is tested against the expected output file.\n# \n# James Andrew Smith; drsmith@yorku.ca August 30, 2024.\n#\n# Based on example by D. Thiebaut at Smith College\n# http:\/\/www.science.smith.edu\/dftwiki\/index.php\/Tutorial:_Moodle_VPL_--_Testing_a_C_Program\n# and\n# https:\/\/www.mapleprimes.com\/posts\/38232-Scripting-With-Maple\n#\n# Modified for Maple and described here: https:\/\/www.yorku.ca\/professor\/drsmith\/2021\/08\/01\/vpl-using-maple-for-math-assignments\/\n#\n# Updated in August 2024 for Kite simulation and RISC-V.\n# A small section of this used Bing\/ChatGPT to generate random values for the registers.\n# -----------------------------------------------------------------\n\n\ncat > vpl_execution <<EEOOFF\n#!\/bin\/bash\n\n# Variables (make changes here)\nteacherSolution=teacherAssemblerSolution.asm\nstudentProgram=StudentSubmission.asm\nmaxGrade=1\nminGrade=0\nconsolationGrade=0\ninit_register_file=\"reg_state\"\n\n# --- randomize the register state file, reg_state ------\n# this section of the bash script was generated used Bing\/ChatGPT\n# vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv\n\n# Generate an array of 32 random 16-bit unsigned integers\ndeclare -a arr\nfor i in {0..31}; do\n    arr[i]=\\$((RANDOM % 65536))\ndone\n\n# Override specific elements with constant values (example: arr[0] = 1234, arr[15] = -5678)\narr[0]=1234                                 # x1 is fixed to 1234\narr[15]=-5678                               # x15 is fixed to -5678\narr[6]=\\$(( \\$RANDOM - 32768 ))             # x6 is a random negative number.\n\n# Create the string with 32 lines in the form A = B\noutput=\"\"\nfor i in {0..31}; do\n  output+=\"x\\$i = \\${arr[i]}\\n\"\ndone\n# ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n# -------------------------------------------------------------------\n\n\n# --- create test (Teacher Solution) ---\n# Write the string to reg_state.txt. (to initialise registers)\necho -e \"\\$output\" > \"\\$init_register_file\"\n\n# run Kite on the teacher solution.  Output to solution.txt.  Extra text to \/dev\/null\necho \"running KITE on teacher solution...\"\n\/eecs\/local\/pkg\/kite\/bin\/kite \\${teacherSolution} > solutionTemp.txt\n\n# erase all lines prior to the string\nsed -i '1,\/Register state:\/d' solutionTemp.txt\n\n# erase all lines at the end of the file after \"elapsed\":\nsed -n '\/elapsed\/q;p' solutionTemp.txt > solution.txt\n\n# Default grade is zero.\ngrade=\\$minGrade\n\nfor i in 1 ; do\n   echo \"TEST \\$i\"\n\n   # ==============================================\n   # TEST i\n   # ==============================================\n\n   # Write the string to reg_state.txt. (to initialise registers)\necho -e \"\\$output\" > \"\\$init_register_file\"\n\n\n   echo \"Running KITE on the student solution...\"\n\n\/eecs\/local\/pkg\/kite\/bin\/kite \\${studentProgram} > userTemp.out\n\n# erase all lines prior to the string\nsed -i '1,\/Register state:\/d' userTemp.out\n\n# erase all lines at the end of the file after \"elapsed\":\nsed -n '\/elapsed\/q;p' userTemp.out > user.out\n\n   # all processing of whitespace to remove it has been, itself removed.\n   # want to see how that's done?  Go to \n   # http:\/\/www.science.smith.edu\/dftwiki\/index.php\/Tutorial:_Moodle_VPL_--_Testing_a_C_Program\n   \n   #--- compute difference, with exact whitespace --- \n   diff -y user.out solution.txt > diff.out\n   \n   # debug:\n #    echo \"----- diff.out ------\"\n #   cat diff.out\n #   echo \"---------------------\"\n\n   \n   #--- reject if different ---\n   if ((\\$? > 0)); then\n      echo \"Your output is NOT correct.\"\n\n\n      echo \"---------------\"\n      echo \"Your output:\"\n      echo \"---------------\"\n      cat user.out\n      \n      echo \"\"\n      echo \"---------------\"\n      echo \"Expected output  \"\n      echo \"---------------\"\n      cat solution.txt\n\n      grade=\\$( expr \\$minGrade )\n   \n      #--- consolation grade (\"thanks for coming out\")---   \n      #grade=\\$( expr \\$consolationGrade )\n\n      # --------------------- REWARD IF CORRECT OUTPUT -----------------\n   else\n      #--- good output ---\n      echo \"Congrats, your output is correct.\"\n      echo \" --------------------------------\"\n      cat user.out\n      echo \"--------------------------------\"\n      grade=\\$( expr \\$maxGrade )\n   fi\ndone\n\n# Uncomment this for the vpl_run.sh\n# Comment it for vpl_evaluate.sh\n<\/mark># echo \"Possible Grade : \\$grade (you need to evaluate for official grade)\"<\/mark>\n<\/strong>\n# Uncomment this for vpl_evaluate.sh.  Otherwise comment it.\necho \"The following grade is being sent to eClass: \\$grade\"\necho \"Grade :=>> \\$grade\"<\/strong><\/mark>\n\nexit 0\nEEOOFF\n\n \nchmod +x vpl_execution\nexit 0<\/code><\/pre>\n\n\n
      \n
      \"VPL
      VPL server selected.<\/figcaption><\/figure>\n<\/div>\n\n\n
      <\/p>\n\n\n\n
      Then, we need to set VPL \"local execution server\".<\/p>\n\n\n\n
      Specify the requested file.  Call it StudentSubmission.asm<\/p>\n\n\n\n
      \"example<\/figure>\n\n\n\n
      Copy the two memory files: mem_state<\/a> and reg_state<\/a>, either from the web simulator or from the GitHub respository.  Upload these to the Execution Files folder.  In the Files to Keep when Running page, check off reg_state, mem_state and teacherAssemblerSolution.asm.<\/p>\n\n\n\n
      In Execution Options, make sure that run script is on autodetect.  Click yes for Run and yes for Evaluate.  Click no for \"evaluate just on submission\" and yes for \"automatic grade\".<\/p>\n\n\n\n
      Conclusion<\/h2>\n\n\n\n
      So, we've now got a proof-of-concept working for Kite simulations with RISC-V assembler student programs working within Virtual Programming Lab.  I'll have to clean this up, make a better tutorial and intro video, but I wanted to post this while it was still on my mind.<\/p>\n\n\n\n
      Acknowledgements<\/h2>\n\n\n\n
      I would like to thank Mr. Paul Griffith and Mr. Jason Keltz for helping get the RISC-V tools set up on our EECS department machines.  Colleagues like Mr. Griffith and Keltz are true anchors for departments, like ours, that are so dependent on technology for both teaching and research. <\/p>\n\n\n\n
      \n\n\n
      \n
      \"a<\/figure>\n<\/div>\n\n\n
      James Andrew Smith is a Professional Engineer and Associate Professor in the Electrical Engineering and Computer Science\u00a0Department<\/a>\u00a0of York University\u2019s\u00a0Lassonde School<\/a>, with degrees in Electrical and Mechanical Engineering\u00a0from the University of Alberta and McGill University.\u00a0\u00a0Previously a program director in biomedical engineering, his research background spans robotics, locomotion, human birth and\u00a0engineering\u00a0education. While on sabbatical in 2018-19 with his wife and kids he lived in Strasbourg, France and\u00a0he\u00a0taught at the\u00a0INSA Strasbourg<\/a>\u00a0and\u00a0Hochschule Karlsruhe<\/a>\u00a0and wrote about his\u00a0personal<\/a>\u00a0and\u00a0professional\u00a0<\/a>perspectives<\/a>.\u00a0\u00a0James is a proponent of using social media to advocate for justice, equity, diversity and inclusion as well as evidence-based applications of research\u00a0in the public sphere.\u00a0You can find him on\u00a0Twitter<\/a>. Originally from Qu\u00e9bec City, he now lives in Toronto, Canada.\u00a0<\/p>\n","protected":false},"excerpt":{"rendered":"
      In another post, I set up a basic Virtual Programming Lab exercise for RISC-V simulations with Assembler coding and the Kite simulator. That example is vulnerable to students hard-coding the register values without actually writing the necessary code. But I wrote it in order to provide a solid first example. Here, we're going to write […]<\/p>\n","protected":false},"author":762,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_kad_blocks_custom_css":"","_kad_blocks_head_custom_js":"","_kad_blocks_body_custom_js":"","_kad_blocks_footer_custom_js":"","footnotes":""},"categories":[43,693,294],"tags":[738,736],"class_list":["post-3583","post","type-post","status-publish","format-standard","hentry","category-assembler","category-risc-v","category-vpl","tag-kite-simulation","tag-kite-simulator"],"taxonomy_info":{"category":[{"value":43,"label":"assembler"},{"value":693,"label":"RISC-V"},{"value":294,"label":"VPL"}],"post_tag":[{"value":738,"label":"Kite simulation"},{"value":736,"label":"Kite simulator"}]},"featured_image_src_large":false,"author_info":{"display_name":"drsmith","author_link":"https:\/\/www.yorku.ca\/professor\/drsmith\/author\/drsmith\/"},"comment_info":"","category_info":[{"term_id":43,"name":"assembler","slug":"assembler","term_group":0,"term_taxonomy_id":43,"taxonomy":"category","description":"","parent":0,"count":30,"filter":"raw","cat_ID":43,"category_count":30,"category_description":"","cat_name":"assembler","category_nicename":"assembler","category_parent":0},{"term_id":693,"name":"RISC-V","slug":"risc-v","term_group":0,"term_taxonomy_id":693,"taxonomy":"category","description":"","parent":0,"count":19,"filter":"raw","cat_ID":693,"category_count":19,"category_description":"","cat_name":"RISC-V","category_nicename":"risc-v","category_parent":0},{"term_id":294,"name":"VPL","slug":"vpl","term_group":0,"term_taxonomy_id":294,"taxonomy":"category","description":"","parent":0,"count":25,"filter":"raw","cat_ID":294,"category_count":25,"category_description":"","cat_name":"VPL","category_nicename":"vpl","category_parent":0}],"tag_info":[{"term_id":738,"name":"Kite simulation","slug":"kite-simulation","term_group":0,"term_taxonomy_id":738,"taxonomy":"post_tag","description":"","parent":0,"count":1,"filter":"raw"},{"term_id":736,"name":"Kite simulator","slug":"kite-simulator","term_group":0,"term_taxonomy_id":736,"taxonomy":"post_tag","description":"","parent":0,"count":1,"filter":"raw"}],"_links":{"self":[{"href":"https:\/\/www.yorku.ca\/professor\/drsmith\/wp-json\/wp\/v2\/posts\/3583","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.yorku.ca\/professor\/drsmith\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.yorku.ca\/professor\/drsmith\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.yorku.ca\/professor\/drsmith\/wp-json\/wp\/v2\/users\/762"}],"replies":[{"embeddable":true,"href":"https:\/\/www.yorku.ca\/professor\/drsmith\/wp-json\/wp\/v2\/comments?post=3583"}],"version-history":[{"count":6,"href":"https:\/\/www.yorku.ca\/professor\/drsmith\/wp-json\/wp\/v2\/posts\/3583\/revisions"}],"predecessor-version":[{"id":3592,"href":"https:\/\/www.yorku.ca\/professor\/drsmith\/wp-json\/wp\/v2\/posts\/3583\/revisions\/3592"}],"wp:attachment":[{"href":"https:\/\/www.yorku.ca\/professor\/drsmith\/wp-json\/wp\/v2\/media?parent=3583"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.yorku.ca\/professor\/drsmith\/wp-json\/wp\/v2\/categories?post=3583"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.yorku.ca\/professor\/drsmith\/wp-json\/wp\/v2\/tags?post=3583"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}