CS 380 2025spring ibarland

home—lectures—recipe—hws—exams—D2L—zoom (snow day)

Shadowing and function-application
hw10: H4

Due 2025-Apr-26 (Sat) 23:59

• Please add a comment “;>>> H3” or “;>>> H4” next to places you add/update for this homework.
• You can add all new tests to the list “all-tests” in the H4-test.rkt (or, ExprTest.java).
• On D2L, submit all files except those provided with H0. (E.g. either H4,-test.rkt, or if using Java then {H4,ExprTest}.java or (if putting classes in multiple files) {Expr{,Test},BinOp,IfPos,Id,Let,Func,FuncApply}.java. No .zip/.jar).
• You need only submit hardcopy of the parts of code that have changed since H2, saving paper.
• Your prolog queries can be inside a comment of a racket file.

We continue to build on the language implementation of H1/H2. You can implement this homework in either Java or Racket. You may use the H2-soln if you want. Link is usuable once you E2L-submit H2; just let me know if you need to bypass that.

H3 is just like H2, except we now allow one variable to shadow another.

For example, we might have a substitute x with … in … which in turn contains another substitute x with … in … somewhere inside of it. In that case the inner x should shadow the outer one:
⇒ substitute x with 7 in substitute x with 5 in add x to 3
⇒ substitute x with 5 in add x to 3¹
⇒ add 5 to 3
⇒ 8.
And of course, shadowing may occur between non-adjacent scopes: substitute x with 3 in substitute y with 4 in substitute x with 5 in ….

So what does our interpreter need to do? Well, when eval does substitution in a LetExpr, we just need to be a bit cautious: If we're substituting every x in an Expr, and we encounter a substitute x with Expr_rhs in Expr_body then we shouldn't substitute any xs inside the Expr_body. Though of course, if we encounter a substitute y with Expr_rhs in Expr_body, then this doesn't affect our substitution.

Using our programming-language vocabulary: when substituting, only substitute “free occurrences” of an Id in E₁, not any “bound occurrences”².

As an example, for the expression substitute x with 3 in shake substitute y with 4 in add x to shake substitute x with 5 in add x to y bake bake, we have the syntax tree drawn at the right albeit with add written as boii, with a dotted-arrow from each binding-occurrence to its bound occurrence(s). This corresponds to some runnable test-cases³:

(check-expect (eval (string->expr "substitute x with 3 in shake substitute y with 4 in add x to shake substitute x with 5 in add x to y bake bake"))
              (+ 3 (+ 5 4)))
(check-expect (subst "x" 3        (string->expr "shake substitute y with 4 in add x to shake substitute x with 5 in add x to y bake bake"))
              (string->expr                     "shake substitute y with 4 in add 3 to shake substitute x with 5 in add x to y bake bake"))

hint/spoiler: in substitute zed with Expr_initialize in Expr_body, we know that

zed can never occur free in Expr_body

. We don't even need to look inside it, if we are only looking for free occurrences of (a surrounding) zed!

0. (0pts) Change the purpose-statement of subst to be “substitute any free occurrences of …”. Note that you will not substitute other binding occurrences, either.
1. For each of the following, fill in the blanks by replacing the outermost LetExpr with just its body, but substituting its variable respecting shadowing. You don't need to submit this, but filling it out is meant to help you understand the problem/issue. If you don't get the code working, but do have a comment with these answers, I can use them to justify partial credit!
   For example (using the program/image above):
   ⇒ substitute x with 3 in shake substitute y with 4 in add x to shake substitute x with 5 in add x to y bake bake
   ⇒ shake substitute y with 4 in add 3 to shake substitute x with 5 in add x to y bake bake
   ⇒ shake add 3 to shake substitute x with 5 in add x to 4 bake bake
   ⇒ shake add 3 to shake add 5 to 4 bake bake
   ⇒ 12
   Complete the blanks in a similar way, below:
   1. ⇒ substitute y with 3 in substitute x with 5 in add x to y
      ⇒                                             
      ⇒                               
      ⇒ 8
   2. ⇒ substitute y with 3 in substitute x with y in add x to y
      ⇒                                                                                                   
      ⇒                               
      ⇒ 6
   3. ⇒ substitute x with 5 in substitute y with 3 in add substitute x with y in add x to y to x
      ⇒                                                                                                                                                                                                   
      ⇒                                                                                                                               
      ⇒                                                         
      ⇒                               
      ⇒ 11
   4. ⇒ substitute x with 5 in substitute x with add x to 1 in add x to 2
      ⇒ substitute      with add      to 1 in add      to 2
      ⇒ substitute      with      in add      to 2
      ⇒ add      to 2
      ⇒     

2. Update H2 to H3, by the necessary changes to enable shadowing.
   You are encouraged to build on your own previous solution, but you may also use the H2-soln (.rkt)

   • The change should be quite small, but is surgically precise.
   • Recall that H2's subst is essentially the same code as change-name in AncTrees.
     Hint: What is needed for H3's (and H4's) subst is essentially the same as exam01's workers-follow-queen-color.
   • Please label each section of lines you change with a comment “;>>>H3”.

H4 adds (non-recursive) functions and function-application to our language:

<Expr> → … | <FuncExpr> | <FuncApplyExpr>   ;>>>H4

<FuncExpr> → recipe using <Id>: <Expr>             ;>>>H4   Interpretation: a function-value, with parameter <Id> and body-<Expr>.
<FuncApplyExpr> → use leftover <Expr>0 in <Expr>1   ;>>>H4   Interpretation: Apply a function (<Expr>1) to an argument (<Expr>0).  Note the order.

Here is the function (λ (x) (+ (* 3 x) 1)) written in H4: recipe using x: add scale x to serve 3 to 1.
And, here is the (uniterated) collatz function, (λ(n) (if (even? n) (* n 1/2) (+ (* 3 n) 1))), written in H4:

recipe using n: sample chop n into 2; add scale n to serve 0.5 to taste or use add scale 3 to serve n to 1 instead

A FuncApplyExpr represents calling a function. Here are two expressions, both evaluating to 5·3+1 = 16:

substitute tripleAndInc
with       recipe using x: add scale x to serve 3 to 1          body of `tripleAndInc`
in         use leftover 5 in tripleAndInc            call tripleAndInc(5)… 


use leftover 5 in recipe using x: add scale x to serve 3 to 1   Equivalent to above: apply a function-literal (w/o bothering to give it a name)

3. First, write the following four functions as H4 programs not as racket programs -- you'll write keywords like recipe using and . They'll just be in comments since they're not racket code. Or hey, you can put them in a string, and then pass those strings to parse as test-cases!.
   1. A constant function that always returns (say) 17.
   2. the function sqr, which squares its input; give it a name with a H4 LetExpr whose body we’ll just leave as “…”. I.e. write the H4 equivalent of racket (let {[sqr (lambda (x) (* x x))]} …). If you like, you can aply the function to 5, instead of writing “…”. That might make things clearer, but on the other hand it involves the syntax for function-creation and function-application, which is why I it's optional.
   3. the factorial function, written in H4 using a LetExpr with body “…” as in the previous example.

      Note: You won’t be able to evaluate function-applications for recursive functions yet (see H5), but we can still write the test cases! (You can comment out that one test case for now, since it’ll trigger a run-time exception otherwise.)

   and
   4. The H4 equivalent of the following racket defining and calling make-adder:

      (define (make-adder n) (lambda (m) (+ n m))) (make-adder 3) ; evals to a *function* -- one that will add three to its input ((make-adder 3) 4) ; evals to 7 ; Note that `(make-adder 3)` evals to `(lambda (m) (+ 3 m))` ; the `((` means we have *two* function-applications: ; we first call `make-adder` (getting back a lambda-value), ; then we call that result we got back.

4. Then, upgrade H3 so that it allows functions to be represented; label each section of lines you change with a comment “;>>>H4”.
   1. Add a struct/class for representing FuncExprs internally.⁴
   2. parse! (and tests).
   3. expr->string (and tests)
   4. eval (and tests).

      Semantics of a function-literal: Just as numbers are self-evaluating, so are FuncExprs. Evaluating (an internal representation of) a function results in that same (internal representation of the) function. We won’t actually evaluate the body until the function is applied. (This is exactly how Java, racket, python, javascript, etc. treat functions.)

   Testing function-values: How can we make a test-cases, when the result isn't a number? For example, for evaluating recipe using n: add n to 1 or use leftover 5 in makeAdder (whose expected-results are both <FuncExpr> structs). You have two approaches:

   • Use check-expect as usual: e.g.

     (check-expect (eval (string->expr "recipe using n: add n to 1")) (make-my-func-expr "n" (make-binop "add" "n" 1)))

     This is more to write than using test-harness, but works just fine.
   • Use the test-harness: adding a <Expr>/result pair to the list-of-tests works mostly as usual, but we need one extra character: a comma, immediately preceding the expected-result. E.g.:

     ["recipe using n: add n to 1" ,(make-my-func-expr "n" (make-binop "add" "n" 1))]

     [optional] Why the comma?: If you want to understand why it doesn't work without a comma, and what the comma does for us, you can read backquote.html (recommended, but not necessary to complete this homework).

     tl;dr: The test-harness's list of program+result pairs isn't created by calling list (over and over for each pair); instead it was created by using a single backquote, “`”: (define all-tests `(("add 2 to 3" 5) …). This quote then distributes over all the nested open-parens to create sub-lists woo-hoo!, a handy time-saver. In fact, it also quotes the values inside those sub-lists — which didn't previously matter to us, because quoting string-literals and integer-literals has no effect ('16 is 16, and '"hello" is "hello").

     However: quoting an identifier turns it into a symbol ('hello is 'hello :-). So `(3 (sqrt 16) 5) is (list 3 (list 'sqrt 16) 5), and not (list 3 4 5) like we hoped. To suppress the quoting of (sqrt 16), we precede it with a comma: `(3 ,(sqrt 16) 5) gives (list 2 3 4). (The comma is known as unquote.)

5. Implement function-application.
   1. Add a struct/class for representing FuncApplyExprs internally.
   2. parse! (and tests)
   3. expr->string (and tests)
   4. eval (and tests). Here, more than half the points are for tests, since you want to try several situations involving shadowing variables. (You don’t need to test eval’ing your factorial function, though.)

      The semantics of eval’ing the function-application use leftover Expr₀ in Expr₁:

      1. Evaluate Expr₀; let’s call the result f. (f had better be a function-value!)
      2. Evaluate Expr₁; let’s call the result actual-arg.
      3. Substitute f’s parameter with actual-arg in f’s body; call this new expression E′.
      4. Evaluate E′ and return that value.
      Hey, those semantics are practically the same as <LetExpr>’s! Indeed, it's just that the identifier, thing-to-substitute, and body aren't all in a single <LetExpr>; now they are divided between a <FuncExpr> and a <FuncApplyExpr>.

   external resource: Another description of this algorithm is in VT's textbook's section A Substitution-Based Model of Evaluation.

The interpreter project is based on the first chapters of Programming Languages and Interpretation, by Shriram Krishnamurthi. As a result, this homework assignment is covered by the Creative Commons Attribution-NonCommercial-ShareAlike 3.0 United States License. Although we’re using a different dialect of racket than that book, you might find it helpful to skim it.

  eval(string->expr("substitute x with 5 in add x to 3"))
= eval(string->expr("add 5 to 3"))
= eval(string->expr("8"))

home—lectures—recipe—hws—exams—D2L—zoom (snow day)

This page licensed CC-BY 4.0 Ian Barland Page last generated

Please mail any suggestions (incl. typos, broken links) to ibarlandradford.edu