D4.4.9-12C3 FrameworkSocial StudiesCommunicating and Taking ActionGrades 9-12
D4.4.9-12: Critiquing Claims and Evidence for Credibility
In plain English: D4.4.9-12 is the C3 Framework inquiry indicator for grades 9-12 that asks students to critique the use of claims and evidence in arguments for credibility. Students test whether each claim stays within what its maker could know and show, and whether the evidence is relevant, independent, sufficient and fairly selected.
Critique the use of claims and evidence in arguments for credibility.
C3 Framework for Social Studies (NCSS) · Dimension 4: Communicating Conclusions and Taking Informed Action · Communicating and Critiquing Conclusions · Official standard
D4.4.9-12 asks students to critique the use of claims and evidence in arguments for credibility. The question is not only whether an argument is believable, but how its maker uses each part: does a claim stay within what its maker could know and show, at the right level of certainty, and in a form that could be tested? Is the evidence relevant, independent of the arguer, sufficient for the claim, fairly selected, and stronger than the alternative explanations? The Claim and Evidence Audit (Diagram 1) collects these tests.
The vehicle is the rain-making craze of the early 1890s, when Congress paid for explosion experiments in Texas and private rain-makers sold their services. Students read a 1894 newspaper report of a California rain-maker, the Stanford physics professor Fernando Sanford's reply built on Weather Bureau maps, Sanford's own general verdict, and two accounts of the federally funded tests by Sanford and by Mark W. Harrington. The sources make strong claims on both sides, which lets students critique the critics as well as the rain-makers. The rubric scores the critique, not which side a student favors.
Learning Objectives
By the end of this lesson, students will be able to:
Critique a claim's use by testing its scope, its certainty, whether its maker could know it, and whether it could be tested
Critique a use of evidence by testing its relevance, independence and sufficiency, and by looking for alternative explanations
Detect selective use of evidence by comparing two accounts of the same event
Apply the same tests to an argument's critics and to an invented economics argument, and state a fair overall judgment
Prior Knowledge Required
Students should already be comfortable with:
Critiquing arguments for credibility D4.4.6-8
Evaluating sources by their origin, authority and context D3.1.9-12
Using evidence from multiple sources to detect inconsistencies and revise claims D3.3.9-12
"A team wears new socks and wins three games in a row. The sock company's ad says, 'Our socks win games.' Write down every reason the evidence might not support the claim. Then rewrite the claim so that the evidence does support it."
Sort students' reasons into two columns on the board. Reasons about the claim (it is too broad, too certain, or not something the company could know) go on the left. Reasons about the evidence (only three games, the team may have improved anyway, the company chose what to report, no comparison with games in old socks) go on the right. These become the two halves of the Claim and Evidence Audit. Tell students that today's arguments are about whether people could make it rain, and that the critics' claims get audited too.
Direct Instruction30 minutes
Part 1: The question and the sources. The compelling question is "How credible were the claims of the 1890s rain-makers, and of their critics?" The debate is a vehicle for the skill. Harrington reports that Senator Farwell obtained appropriations "first of $2,000, then of $7,000" and that the Department of Agriculture chose R. G. Dyrenforth to run the experiments (Source 5, paragraph 1). Dyrenforth's method was concussion: explosions meant to jar clouds into releasing rain. In Sources 1-4, Sanford, a physics professor at Stanford, reads a newspaper report about a California rain-maker to his students in 1894 and then answers it. Harrington wrote for the National Geographic Magazine in 1894, while he was Chief of the U.S. Weather Bureau (its first chief, 1891-1895, according to the National Weather Service); the Weather Bureau was then part of the Department of Agriculture, the department that ran Dyrenforth's tests. He says he "personally urged" Dyrenforth to add a check (Source 5, paragraph 7). Source 8, also from Harrington, quotes a letter by Professor A. Macfarlane of the University of Texas, an "uninvited guest" at the 1892 San Antonio test.
Source Information: who made each source, when, and from what position (from the sources, their bylines and their notes)
Source
Maker and position
When
Position
1: Examiner report
The San Francisco Examiner, as read aloud by Sanford
February 2, 1894
Reports that Frank Baker made rain at Pixley
2-4: Sanford
Fernando Sanford, Professor of Physics, Leland Stanford Junior University, in a lecture to students
March 1894, printed August 1894
Against all rain-making claims of his day
5: Harrington
Mark W. Harrington, Chief of the U.S. Weather Bureau, writing in the National Geographic Magazine
1894, reprinted 1896
Skeptical; reports evidence on both sides
8: Macfarlane via Harrington
A. Macfarlane, University of Texas, an uninvited observer
Letter of December 4, 1892
Skeptical eyewitness of the San Antonio test
6 and 7
Invented critiques and an invented scenario written for this page
Invented
Practice material; two critiques in Source 6 are deliberately weak
1HE PRODUCES RAIN AT WILL. Highly Successful Experiments of the Visalia Rain-maker. HEAVY SHOWERS AT PIXLEY. He selects the Driest Section of Fresno County, where Rain seldom falls, and BY the Use of Chemicals causes Local Downpours on Two Successive Days. Many other Tests made.
2Visalia, February 1st.—A week ago Wednesday Frank Baker, of Visalia, an amateur rain-maker, went to Pixley for the purpose of producing rain. Before he left he informed the Examiner correspondent that he intended to produce rain within seven days, and he kept his word. On Tuesday and Wednesday a local rainstorm occurred in the vicinity of Pixley amounting to 0·35 to 0·45 of an inch.
[...]
3During the months of April and May he proposes to put forth his best efforts in order to thoroughly drench the soil. The residents of Pixley are well pleased with Baker's experiments, and they propose to assist him in conducting his future operations.
4THEY VOUCH FOR HIS EFFICIENCY. He brought back with him the following letter:
5"This is to certify that it rained 0·35 to 0·40 of an inch at Pixley on the 30th and 31st of January. We gentlemen here vouch for the truth of the same; that it is a local rain of fifteen to twenty miles in extent, and that it was brought about by the Baker process.
6"J. J. Kelly, L. E. Smith, "Charles S. Peck, J. T. Austin, "W. M. Jackin, John W. Harper."
San Francisco Examiner, quoted by Fernando Sanford, The San Francisco Examiner on the Pixley rain-maker, February 2, 1894, as quoted by Sanford (Source 1) (1894). Public domain (published 1894). Source text.
1Now, it is not my purpose to impugn the veracity of the gentlemen whose names are signed to this certificate. I know none of the gentlemen. I do not question the only point in the statement to which the gentlemen could possibly subscribe of their own knowledge. You will observe that the certificate includes three separate statements: (1) That it rained in Pixley on the 30th and 31st of January; (2) that it was a local rain of fifteen to twenty miles in extent; (3) that it was brought about by the Baker process. Manifestly, the only one of these statements to which the gentlemen could have subscribed of their own knowledge is the first.
2Fortunately for the settlement of questions of this character, we have the use of data collected by the Weather Bureau. When I read the above article I at once wrote to Mr. Pague for the maps issued by the Weather Bureau for January 28th to 31st inclusive. He kindly forwarded them to me, and the following data were compiled by me from them:
3On the map of Sunday, January 28th, 5 P. M., an area of low barometer is shown with its center west of Vancouver. The weather was reported cloudy and rainy north of the Oregon line. The weather forecast was "Rain in northern California." Twelve hours later, Monday, January 29th, at 5 A. M., the storm was central over northwestern Washington. I quote verbatim from the predictions printed upon the map: "The conditions this morning are favorable for rain over California from the Tehachapi Mountains northward by Tuesday morning, and possibly will extend southward Tuesday afternoon or night."
4At 5 p. m. of the same day the map shows a storm area extending from British Columbia to southeastern California, with its center near Keeler, about ninety miles east of Pixley. Here the storm center remained for thirty-six hours, while the storm was gradually breaking up over its northern part, as shown by the three following maps, and not until the map of Wednesday morning is there an indication of an eastward movement of the storm, while as late as 5 p. m. of Wednesday, January 31st, rain was reported at Keeler. During Monday and Tuesday light rains were reported over nearly all parts of the State, and on Tuesday it rained at Pixley.
5[...] As a matter of fact, it rained at Pixley on Tuesday night, as had been predicted by Mr. Pague thirty-six hours before.
Fernando Sanford, Sanford checks the Pixley claim against Weather Bureau maps, 1894 (Source 2) (1894). Public domain (published 1894). Source text.
1And now as to the possibility of producing rain by artificial means. It is never safe to say what things are possible and what things are impossible to man. What the future may bring forth no one can tell. At the present time, however, there is no evidence to show that even the smallest local shower has been produced artificially. Further than that it is safe to say that no method of producing artificial rain has yet been publicly proposed which suggests to one familiar with the scientific principles involved even a possibility of success. That such attempts have received the official recognition and the financial support of Congress is only another evidence of the gross ignorance of scientific principles which is prevalent among our so-called educated men. That some of the men who advocate these wild schemes are honest in their motives can not be questioned, but that all the professional rain-makers are conscienceless fakirs is scarcely more questionable. That many of them are able to submit testimony as to the efficacy of their system is equally true of every patent-medicine fraud and electric-healing quack who has ever swindled an ignorant public. As an illustration of the value of testimony of this kind let me give you a local example.
Fernando Sanford, Sanford's general verdict on rain-making, 1894 (Source 3) (1894). Public domain (published 1894). Source text.
1Dyrenforth.—It is probable that the name of Mr. Dyrenforth is better known in connection with attempts at artificial rain-making than that of any other man. As a result of the agitation of Mr. Powers, Congress voted two thousand dollars to make a preliminary test, and the inquiry fell to the scientists connected with the Department of Agriculture. They reported that there was no foundation for the opinion that days of battle were followed by rain any more than days of no battle. It was then that Mr. Dyrenforth came forward with Ruggles's plans and offered to make some tests. Through the influence of Senator Farwell, an additional appropriation of seven thousand dollars was placed at his disposal for a series of practical tests, which were made at Midland, Texas, in August, 1891. A further Government appropriation was expended in tests at San Antonio, Texas, in November, 1892.
2Mr. Dyrenforth's plan seems to have been to imitate as nearly as possible the conditions of a battle. His explosives were ranged in a line facing the advancing clouds. Shells were fired into the air at frequent intervals. Dr. Macfarlane states that the "general" and his lieutenant even wore cavalry boots.
[...]
3Under these conditions eight balloons, a hundred and fifty shells, and four thousand pounds of rosellite were fired off. No rain appeared. One balloon exploded within a black rain cloud, but failed to produce any precipitation. On the following Wednesday, with a clear sky, ten balloons, a hundred and seventy-five shells, and five thousand pounds of rosellite were exploded, and the sky remained clear. On the following night the remaining stock of explosives were fired off, regardless of consequences, to get rid of them.
Fernando Sanford, Sanford on Dyrenforth's tests in Texas, 1894 (Source 4) (1894). Public domain (published 1894). Source text.
1Senator Farwell, however, continued his interest in the matter, and in 1890 finally succeeded in obtaining an appropriation, first of $2,000, then of $7,000, for carrying on the experiments, some of which he had already had made at his own expense. The appropriation assigned the conduct of the experiments to the Department of Agriculture, and the Secretary selected R. G. Dyrenforth for the work. The experiments were carried on in the vicinity of Washington and in Texas. A report from Mr. Dyrenforth was published by Congress in 1892. At the next session of Congress another appropriation of $10,000 was made for this purpose, of which the sum of $4,913.59 was expended, as before, under Dyrenforth's direction, the remainder having been covered back into the Treasury.
2Mr. Dyrenforth's methods were highly ingenious. He used a variety of explosives, on the ground and in the air, by great single explosions and by volleys. He introduced many novelties, among them that of exploding the gas in the balloon itself when high in the air. His conclusions, as stated by himself in his first report, were (p. 59):
3"First. That when a moist cloud is present, which, if undisturbed, would pass away without precipitating its moisture, the jarring of the cloud by concussions will cause the particles of moisture in suspension to agglomerate and fall in greater or less quantity, according to the degree of moistness of the air in and beneath the cloud.
4"Second. That by taking advantage of those periods which frequently occur in droughts, and in most if not in all sections of the United States where precipitation is insufficient for vegetation, and during which atmospheric conditions favor rainfall, without there being actual rain, precipitation may be caused by concussion.
5"Third. That under the most unfavorable conditions for precipitation, conditions which need never be taken in operations to produce rain, storm conditions may be generated and rain be induced, there being, however, a wasteful expenditure of both time and material in overcoming unfavorable conditions."
6His second report has not been published, but I infer that his second series of observations were believed by him to confirm the results of the first.
7Mr. Dyrenforth generally omitted one check which he might well have employed, and which I personally urged him to employ. Experiments of this sort, made in the free air, with the accompanying conditions not under control, should be accompanied with every possible check; and one self-evident and very necessary one is the observation of a physicist familiar with the meteorologic side of physics. Such an expert (Mr. G. E. Curtis) accompanied the party in its first experiments. His report (except the bare meteorologic record made during the experiments) does not accompany Dyrenforth's document. It was presented, however, to the Philosophical Society of Washington, and was printed elsewhere. Mr. Curtis says, substantially, that an explosion in a cloud brings down a few scattering drops of rain, and this may happen even with an explosion on the ground, if heavy. Otherwise he says there was no rain making. It is but fair to say that with Mr. Dyrenforth's report are given the reports of his assistants, Mr. John T. Ellis, Lieut. S. A. Dyer, and Mr. Eugene Fairchild, and they were stronger in the expression of a belief that rain was successfully made than is Mr. Dyrenforth; and there are also many favorable quotations from spectators.
Mark W. Harrington, Mark W. Harrington on Dyrenforth's experiments and conclusions, 1894 (Source 5) (1894; this edition 1896). Public domain (published 1896). Source text.
1Prof. A. Macfarlane, of the University of Texas, was present as an uninvited guest during the elaborate experiments near San Antonio on Friday, November 25, 1892, beginning at 4 p. m. The sky was from time to time overcast, and the natural conditions were not unfavorable for rain. Many explosions were made without rain until late in the evening, from which point I will take up the story in Professor Macfarlane's own words, as given in a letter to the New York World December 4, 1892:
2"At 10.15 a balloon was sent up and was lost in the darkness; when it exploded a very large area of light was seen, as if the explosion had occurred inside a cloud. There was no fall of rain at the camp, and nobody was stationed below the spot where the balloon exploded.
3"I consider this the only experiment that was worth making, yet no care was taken to observe whether rain did fall. It is conceivable that the explosion of a 12-foot balloon inside a cloud ready to precipitate may jar the particles so as to quicken the dropping of the rain. This was the idea of Ruggles. But to test whether some rain can be drawn down in this manner from a rain cloud does not suit the ideas of cranks who wish to get a large something out of an absolute nothing.
[...]
4"At 1 o'clock, the time when operations were to be suspended for the night, it was fair, with some stars visible, and the boys were preparing one more balloon. Colonel King remarked that it would be necessary to keep up the operations for forty-eight hours. I retired to a room in the hotel, from which I could see the operations.
5"At 1.30 I heard a slight shout from the balloon boys, and I could hear the rain pattering on the roof. The General, who had also retired to the hotel, threw open the window and called out: 'Hurry up, boys.' After ten minutes the balloon was exploded, and the rain almost immediately diminished so as to be scarcely perceptible. When the explosion occurred I had my head out of the window. The hotel, a frame house, shook considerably, but there was no breaking of glass or any of the effects produced by a powerful explosion on the solid earth.
6"At 1.50 the General went out to observe, and I heard him say: 'There is a beautiful rain to the north of us and to the west of us.'
7"At 2 the rain had entirely ceased, and the last of the operations consisted of two shells fired in succession at 2.05."
A. Macfarlane, quoted by Mark W. Harrington, Professor Macfarlane's account of the San Antonio night, as quoted by Harrington, 1894 (Source 8) (1894; this edition 1896). Public domain (published 1896). Source text.
Part 2: Model the audit. Work through the examples aloud with Diagram 1. Terms to define as they come up: precipitation is rain or snow; an "area of low barometer" on a weather map is a low-pressure storm; to "agglomerate" is to clump together; rosellite was an explosive. Point out that the audit has two halves: Examples 1, 3 and 5 test claims, and Examples 2 and 4 test evidence. Example 5 turns the audit on a critic, because a critic's claims need the same tests.
Claim: what could the claimant know? (Source 1)
Six Pixley men certify that "it rained 0·35 to 0·40 of an inch at Pixley on the 30th and 31st of January", that it was "a local rain of fifteen to twenty miles in extent", and "that it was brought about by the Baker process" (Source 1, paragraph 5). Critique the use of these claims.
Result: The certificate bundles three claims of very different strength. Rain on two days is something the signers could observe. The rain's extent of fifteen to twenty miles is wider than anyone in one town could see. The cause is not observable at all, so their signatures add nothing to it. Sanford makes this split himself (Source 2, paragraph 1). Credible use: cite the certificate for the rain, not for its cause.
Evidence: an alternative explanation and its timing (Source 2)
Baker's evidence is that rain followed his work. Sanford answers with the Weather Bureau's maps and forecasts (Source 2, paragraphs 3-5). How does this change the credibility of Baker's evidence?
Result: The forecast issued on Monday morning said conditions were "favorable for rain over California from the Tehachapi Mountains northward by Tuesday morning" (paragraph 3), and it rained at Pixley Tuesday night, "as had been predicted by Mr. Pague thirty-six hours before" (paragraph 5). Rain that an independent forecaster expected anyway cannot count as evidence that Baker caused it: rain after an action is not rain because of it. Limitation: Sanford's maps report regional stations; he quotes no gauge reading taken at Pixley itself.
Claim: scope and testability (Source 5)
Dyrenforth's third conclusion says that "under the most unfavorable conditions for precipitation", rain can "be induced", although with "a wasteful expenditure of both time and material" (Source 5, paragraph 5). Critique the claim.
Result: The claim is as broad as possible (the worst conditions) yet names no amount, place or number of trials, and its built-in excuse (waste) means a failure can always be read as "not enough material yet". A claim that no result could count against is hard to test, so it earns little credibility however confident it sounds. A credible version would state conditions, amount and how success would be measured.
Evidence: independence and missing checks (Source 5)
Harrington says Dyrenforth's report omits the full report of G. E. Curtis, the expert observer, but includes reports from three assistants and "many favorable quotations from spectators" (Source 5, paragraph 7). Critique Dyrenforth's use of evidence and Harrington's.
Result: Dyrenforth's report keeps the evidence of people on his own team, who were "stronger in the expression of a belief" than he was, and leaves out the independent expert, who says "there was no rain making": a selection problem. Harrington's critique gains credibility by reporting the favorable evidence too ("It is but fair to say"). Its limitation: he gives Curtis's view only "substantially", in his own summary, and he was involved, having "personally urged" a check.
Critiquing the critic (Source 3)
Sanford says that "all the professional rain-makers are conscienceless fakirs is scarcely more questionable" (Source 3). Critique his claim and its evidence.
Result: His narrower claim, that "there is no evidence to show that even the smallest local shower has been produced artificially", can be tested against the cases he cites. The sweeping claim about "all" rain-makers goes beyond his evidence: he offers "a local example", one case, and the word "fakirs" (frauds) is an insult, not a finding. It also sits oddly beside his own admission that some advocates "are honest in their motives". A credible critic keeps the strong claim and drops the insult.
Guided Practice15 minutes
Pairs read Source 6, four invented critiques. Tell students that two of them are deliberately weak. For each critique, pairs name the audit test it uses, judge whether it is fair to the source, and rewrite the weak ones.
1These four critiques were written for this page by invented students who read Sources 1-5. Two of them are deliberately weak, so that the class can find what is wrong with them. They are not models.
2Jonah: "The Pixley certificate is worthless because the six men were probably lying."
3Priya: "The certificate mixes something the signers saw, rain on two days, with something they could not see, what caused it. Only the first is eyewitness evidence."
4Tomas: "Dyrenforth's tests must have worked, because Congress paid for them twice."
5Grace: "Harrington's critique is stronger than Sanford's general verdict, because Harrington names a missing check and also reports the evidence on Dyrenforth's side."
SVHS (invented scenario written for this page), Four Critiques of the Rain-Making Evidence (Source 6: invented student work; two are deliberately weak). Original passage written for this page.
Teacher key (discussion points). Jonah's critique is weak: it accuses the signers of lying with no evidence, while Sanford himself says "it is not my purpose to impugn the veracity" (truthfulness) of the signers (Source 2, paragraph 1). The real problem is what they could know. Priya's critique is strong: it separates an observation from a cause. Tomas's critique is weak: funding shows that Congress was persuaded, not that rain was made; Harrington reports that of a later $10,000 appropriation only "$4,913.59 was expended" (Source 5, paragraph 1), which says nothing about results either way. Grace's critique is strong: it judges the critics by the same tests.
Independent Practice10-15 minutes
Each student writes one paragraph answering the compelling question. It must audit one claim and one use of evidence from the rain-makers' side and one of each from the critics' side, cite sources by paragraph, and end with an overall judgment that says how credible each side's argument was and why.
Closure10 minutes
Exit ticket: "Name one claim from today that went beyond its evidence, and rewrite it so that it doesn't. Then name one piece of evidence that was strong because of who collected it."
Teacher note on the sources: Sanford and Macfarlane use insults ("fakirs", "cranks"); treat these as claims to audit, not as evidence. In the 1890s "fakir" was slang for a swindler, borrowed from a word for a Muslim or Hindu religious ascetic; Sanford's use has nothing to do with that religious meaning, and students should not use the word as an insult. The excerpts are about physics and evidence, not about any group of people. Present the rain-makers' supporters fairly: the Examiner calls the Pixley area the "Driest Section of Fresno County", Dyrenforth's own conclusions speak of regions "where precipitation is insufficient for vegetation", and the Pixley report says residents were "well pleased", so their hopes are part of the story.
Quiz passage. Questions 11-14, 19 and 20 use Source 7, an invented economics scenario.
1This scenario is invented for this page. The city, the people and all the numbers are invented.
2The invented city of Riverton held a Friday night market downtown every week in June for the first time. The market's organizers want the city council to pay for it again next year.
3Source 7A, the organizers' report: "The night market boosted downtown sales by 25%. Every business downtown benefited."
4Source 7B, the organizers' evidence: four shops that sold goods at the market reported total sales of $48,000 in May and $60,000 in June. The organizers chose the four shops.
5Source 7C, the city finance office: sales-tax receipts from all downtown businesses were $410,000 in June this year and $386,800 in June last year.
6Source 7D, a downtown bakery owner: "Market nights took away my customers' parking, so I closed early on Fridays in June."
7Source 7E, a weather note in the report: May had 9 rainy days and June had 2.
SVHS (invented scenario written for this page), The Riverton Night Market Report (Source 7: an invented scenario for the quiz). Original passage written for this page.
Differentiation Strategies
For Struggling Students
Give a two-column organizer, Claim tests and Evidence tests, with the audit questions printed in each column
Read Source 1 and Source 2 together first, since Source 2 answers Source 1 point by point
Provide frames: "The claim says ___, but the evidence shows only ___." "Another explanation is ___."
For Advanced Students
Compare Sanford's account of San Antonio (Source 4) with Macfarlane's (Source 8) and write a judgment on how each uses the same night's evidence
Rewrite Dyrenforth's three conclusions (Source 5) as testable claims, each with a measurement that could prove it wrong
Audit Harrington the way he audits Dyrenforth: what checks does Source 5 itself leave out?
Assessment Guidance
What to Look For
Strong work audits claims and evidence separately: it names when a claim exceeds what its maker could know or show, and when evidence is not independent, not sufficient, selectively reported, or weaker than another explanation. It applies the same tests to critics and supporters and ends with a fair, specific judgment. Watch for critiques that call sources liars without evidence, and for judgments that rest on who won the debate later rather than on the evidence in the sources.
02
Classroom Activities
3 Activities
1
Claim Splitter
15 minGroups of 3
Each group gets four claim cards quoted from the sources. For each card, the group splits the claim into what was observed, what was inferred (concluded from the observation) and what was assumed, then rewrites the claim at the level its evidence supports.
The Four Claim Cards
"Many other Tests made." (Source 1, paragraph 1)
"Mr. Dyrenforth's methods were highly ingenious." (Source 5, paragraph 2)
"That such attempts have received the official recognition and the financial support of Congress is only another evidence of the gross ignorance of scientific principles which is prevalent among our so-called educated men." (Source 3)
"Colonel King remarked that it would be necessary to keep up the operations for forty-eight hours." (Source 8, paragraph 4)
Answer Key for the Teacher
Card 1: nothing observed is reported; the claim of other tests has no number, place or result, so it adds no evidence. Rewrite: "Baker says he made other tests; the report gives no results."
Card 2: observed: the variety of explosives and balloons in the same paragraph. Ingenious describes the method, not the results, so it is not evidence that rain was made.
Card 3: observed: Congress paid for tests. Inferred: educated men are ignorant of science. The step from funding to general ignorance is assumed, not shown. Rewrite: "Congress funded tests that, in Sanford's view, rested on mistaken physics."
Card 4: observed: no rain by 1 o'clock. Assumed: more hours would succeed. Extending the time after a failure makes the claim harder to test.
Discussion
Which card was hardest to split? Ask whether a claim can be fully credible when its maker never says what result would count against it.
2
Evidence Ledger
15 minPairs
Pairs build a ledger of six pieces of evidence used in the debate and rate each one on three tests: relevant (does it bear on whether explosions or chemicals caused rain?), independent (was it collected by someone without a stake in the result?) and sufficient (is there enough of it for the claim it supports?). Each test is scored 0, 1 or 2.
The Six Entries
The Pixley certificate (Source 1, paragraph 5)
The Weather Bureau maps and forecast (Source 2, paragraphs 3-5)
The preliminary test by Department of Agriculture scientists, as Sanford reports it (Source 4, paragraph 1)
The reports of Dyrenforth's three assistants (Source 5, paragraph 7)
The "many favorable quotations from spectators" (Source 5, paragraph 7)
G. E. Curtis's view, as Harrington summarizes it (Source 5, paragraph 7)
Answer Key for the Teacher
Certificate: relevant to whether rain fell, independent of Baker only in part (the report says residents "propose to assist him"), and not sufficient for cause.
Weather Bureau maps: relevant, independent (made for forecasting, before the claim), and strong for an alternative explanation.
Department of Agriculture test: relevant and comparative, since Sanford says the scientists found no more rain after "days of battle" than after "days of no battle"; but the report itself is not quoted, so it is Sanford's summary.
Assistants: relevant but not independent; they worked for Dyrenforth.
Spectators: not independent of their hopes and not trained observers; Harrington gives no count or names.
Curtis: independent and expert, but known here only through Harrington's summary.
Modification for a Debate Format
Assign half the class the rain-makers' side and half the critics' side. Each side must present its two strongest ledger entries and concede its weakest one before rebuttals begin.
3
Design the Test That Would Convince Harrington
15 minGroups of 4
Using Harrington's call for "every possible check" (Source 5, paragraph 7) and Sanford's use of forecasts (Source 2), groups write a one-page plan for a rain-making test whose results both a rain-maker and a skeptic would have to accept.
The Plan Must Say
The exact claim being tested, with amount, place and time.
What will be compared, so that rain that would have fallen anyway is not counted.
Who measures and who records, and why they are independent.
What result would count against the claim, decided before the test.
Answer Key for the Teacher
Strong plans fix the prediction in advance, use rain gauges both under the explosions and at places away from them, and compare test days with the official forecast and with similar days without explosions.
They name an independent expert observer, the check Harrington says Dyrenforth "generally omitted", and publish all results, including failures.
They state a failure condition, which answers the problem of open-ended claims such as extending operations after a failure.
03
Diagrams & Visual Aids
1 diagrams
Diagram 1: The Claim and Evidence Audit
The audit has two halves. A claim is tested for scope, certainty, whether its maker could know it, and whether a result could count against it. Evidence is tested for relevance, independence, sufficiency, alternative explanations and selective reporting. The final question joins the halves: does this evidence carry this claim as stated? The same audit applies to critics.
04
Homework Assignment
~30 min
D4.4.9-12 Homework: Auditing Both Sides
Directions: Use Sources 1-5 and 8 (printed in the Direct Instruction section). Cite every piece of evidence by source and paragraph. Answer Problems 1-5 in four to six sentences each, and Problem 6 in one paragraph.
Part 1: Auditing Claims (Problems 1-3)
Dyrenforth's second conclusion says that precipitation may be caused by concussion "in most if not in all sections of the United States where precipitation is insufficient for vegetation" (Source 5, paragraph 4). Audit the scope and certainty of this claim, and rewrite it at the level the evidence in Sources 5 and 8 supports.
Harrington writes that Dyrenforth's "second report has not been published, but I infer that his second series of observations were believed by him to confirm the results of the first" (Source 5, paragraph 6). Is this a fair use of an inference? Explain what Harrington knows, what he infers, and how a reader should use the sentence.
Sanford reports that Dyrenforth's "general" and his lieutenant "even wore cavalry boots" (Source 4, paragraph 2). Explain whether this detail is evidence about rain-making, and what it does to the credibility of Sanford's account.
Part 2: Auditing Evidence (Problems 4-6)
The Examiner reports that "The residents of Pixley are well pleased with Baker's experiments" (Source 1, paragraph 3). Audit this as evidence: whose view is it, how does the report know it, and what evidence would show what the residents really thought?
Reconstruct Sanford's argument in Source 2 as one claim and three pieces of evidence, and name one limitation of his evidence that a defender of Baker could raise.
Write one paragraph that answers the compelling question for both sides. Audit one claim and one use of evidence from each side, and end with a judgment on which side used its evidence more credibly.
Rubric
Criterion
Full Credit (2 pts)
Partial Credit (1 pt)
No Credit (0 pts)
Critique of claims
Tests scope, certainty, knowledge or testability with exact wording from the source
Names a problem with the claim without the source's wording
No critique of the claim
Critique of evidence
Tests relevance, independence, sufficiency, alternatives or selection with specific evidence
Names a general weakness of the evidence
No critique of the evidence
Fairness to both sides
Applies the same tests to rain-makers and critics and avoids unsupported accusations
Audits one side much more closely than the other
Audits one side only
Judgment
States a specific overall judgment that follows from the audit
States a judgment with thin support
No judgment
05
Quiz: 20 Questions
Interactive, with answers
Instructions
Questions 1-10 and 15-18 use Sources 1-5 and 8 (in the Direct Instruction section). Questions 11-14, 19 and 20 use Source 7, the invented Riverton scenario (in the Closure section). For each multiple-choice question, choose the best answer. For short-answer questions, write four to six sentences.
Multiple choice: pick an option to check it. Short answer: write your answer, then reveal the model answer.
0 of 20 answered · 0 correct
Question 1 of 20 · Multiple Choice
The Examiner's headline says "HE PRODUCES RAIN AT WILL." (Source 1, paragraph 1). What is the main problem with this claim?
Answer: B
"At will" means whenever he wishes, but the report describes one rainstorm after one visit. The claim's scope is far wider than its evidence. A and C misread the report, and D is wrong because the report is dated February 2, 1894, before the March lecture.
Question 2 of 20 · Multiple Choice
The Examiner reports "0·35 to 0·45 of an inch" of rain (Source 1, paragraph 2), while the certificate says "0·35 to 0·40 of an inch" (paragraph 5). What does the difference suggest?
Answer: A
Two reports of the same rain give different upper figures, and neither names a gauge, so the amounts look like estimates rather than measurements. B, C and D have no support in the source.
Question 3 of 20 · Multiple Choice
Before going to Pixley, Baker said "he intended to produce rain within seven days, and he kept his word" (Source 1, paragraph 2). Why is this kept promise weak evidence?
Answer: C
A prediction that names no amount, place or exact time can be met by any rain in a week, so meeting it shows little. A contradicts the report, B is false (it did rain, as the maps show), and D is not in the source.
Question 4 of 20 · Multiple Choice
Macfarlane writes that at San Antonio, "After ten minutes the balloon was exploded, and the rain almost immediately diminished so as to be scarcely perceptible" (Source 8, paragraph 5). How does this observation bear on the concussion claim?
Answer: B
If concussion jars rain out of clouds, an explosion during rain should not be followed by less rain, so this observation counts against the claim (one observation, not proof). A reverses it, C contradicts the rain he heard, and D contradicts paragraph 5.
Question 5 of 20 · Multiple Choice
Sanford notes that the storm's center sat "near Keeler, about ninety miles east of Pixley" for thirty-six hours (Source 2, paragraph 4). What does this detail add to his argument?
Answer: A
A storm centered nearby for a day and a half is an alternative explanation for rain at Pixley. B confuses the places, C contradicts "on Tuesday it rained at Pixley", and D misreads the point.
Question 6 of 20 · Multiple Choice
Sanford adds that "During Monday and Tuesday light rains were reported over nearly all parts of the State" (Source 2, paragraph 4). Which claim in the certificate does this most directly challenge?
Answer: C
Rain over "nearly all parts of the State" is hard to square with "a local rain of fifteen to twenty miles in extent". Sanford does not dispute that it rained at Pixley (A) or in January (D), and B is not in question.
Question 7 of 20 · Multiple Choice
Sanford writes, "At the present time, however, there is no evidence to show that even the smallest local shower has been produced artificially" (Source 3). What does "At the present time" do to his claim?
Answer: A
The phrase keeps his claim about the evidence of 1894, not about all future possibility, which matches his earlier sentence that "What the future may bring forth no one can tell". B and C go beyond the text, and D confuses this sentence with his later insults.
Question 8 of 20 · Multiple Choice
Sanford says that being "able to submit testimony as to the efficacy of their system is equally true of every patent-medicine fraud" (Source 3). What point is he making about evidence?
Answer: B
If frauds can also collect testimonials, testimonials cannot separate a working method from a useless one; another kind of evidence is needed. A reverses the point, C is the opposite of "fraud", and D contradicts the sentence.
Question 9 of 20 · Multiple Choice
Sanford reports that at San Antonio, after the firing, "No rain appeared" (Source 4, paragraph 3). How does Source 8 complicate this summary?
Answer: D
Macfarlane, whom Sanford also relies on, reports rain "pattering on the roof" at 1.30, so Sanford's summary leaves out a detail, even though the rain did not follow the explosions as claimed. A, B and C contradict Source 8.
Question 10 of 20 · Multiple Choice
Sanford says the first $2,000 paid for a "preliminary test" by Department of Agriculture scientists before Dyrenforth "came forward" (Source 4, paragraph 1). Harrington says the appropriation went "first of $2,000, then of $7,000" to experiments run by Dyrenforth (Source 5, paragraph 1). What is the most careful conclusion?
Answer: B
The two accounts give different uses for the $2,000, and nothing in Sources 4 and 5 shows which is correct, so a careful writer notes the conflict. A and C judge by the writer, not the evidence (and Harrington's article is from the same year), and D misreads both.
Question 11 of 20 · Multiple Choice
Source 7A says, "Every business downtown benefited." Which source most directly challenges this claim?
Answer: C
One business that closed early on market nights is a counterexample to "every business". 7B covers only four chosen shops, 7C is a total that cannot show each business, and 7E is about weather.
Question 12 of 20 · Multiple Choice
What is the main weakness of the evidence in Source 7B?
Answer: D
The four shops were chosen by the organizers and all sold at the market, so they are the shops most likely to gain; they cannot stand for all downtown. A is not a weakness, B is false, and C confuses 7B with 7C.
Question 13 of 20 · Multiple Choice
Source 7B compares May with June. What does Source 7E suggest about that comparison?
Answer: A
May had 9 rainy days and June 2, so shoppers may have come out more in June anyway: an alternative explanation. B reverses the logic, C reverses the numbers, and D misreads the note.
Question 14 of 20 · Multiple Choice
Which use of evidence best tests the claim that the market "boosted downtown sales"?
Answer: D
Source 7C covers all downtown businesses and compares the same month a year apart, which removes the seasonal difference; it shows a rise of about 6%. It still cannot rule out other causes. A is selective, B is one case, and C is not sales evidence.
Question 15 of 20 · Short Answer
Audit Dyrenforth's first conclusion (Source 5, paragraph 3): "the jarring of the cloud by concussions will cause the particles of moisture in suspension to agglomerate and fall". Critique the claim, then critique the evidence that Sanford gives against it in Source 4, paragraph 3.
Model answer: The claim says concussion "will cause" rain, a certain and general claim, though "in greater or less quantity" leaves no amount that could prove it wrong. Sanford's evidence bears directly on it: "One balloon exploded within a black rain cloud, but failed to produce any precipitation" (Source 4, paragraph 3), which is the exact case the conclusion describes. Its limits: it is one balloon, Sanford was not there and relies on Macfarlane's paper, and he is openly hostile to rain-makers, so a fair critic would want a measurement under the cloud. Rubric: full credit for a critique of the claim's certainty or testability and of the relevance and the limits of Sanford's evidence; partial credit for one half.
Question 16 of 20 · Short Answer
Macfarlane writes that "no care was taken to observe whether rain did fall" under the 10.15 balloon (Source 8, paragraph 3), and later reports the General saying, "There is a beautiful rain to the north of us and to the west of us" (paragraph 6). Critique how the experimenters used evidence that night.
Model answer: The one test that could have shown an effect was not measured, because "nobody was stationed below the spot where the balloon exploded" (paragraph 2). The General's report of rain elsewhere was unmeasured and could not be tied to any explosion, yet it points to success wherever rain happened to fall. Both show evidence gathered to support a result rather than to test it. Rubric: full credit for explaining both problems with quotations; partial credit for one.
Question 17 of 20 · Short Answer
Critique Macfarlane as a witness (Source 8). Name two strengths and one limitation of his evidence.
Model answer: Strengths: he was present as "an uninvited guest", so he was not on Dyrenforth's team, and he gives exact times for each event, such as "At 1.30" and "At 2", which make his account checkable against others. Limitation: he was in a hotel room from about 1 o'clock, and he calls the experimenters "cranks", so he was hostile to their idea and did not see everything outdoors. Rubric: full credit for two specific strengths and one specific limitation with quotations; partial credit for two of the three.
Question 18 of 20 · Short Answer
Answer the compelling question in one paragraph: "How credible were the claims of the 1890s rain-makers, and of their critics?" Audit at least one claim and one use of evidence from each side.
Model answer: The rain-makers' claims were low in credibility: "HE PRODUCES RAIN AT WILL" rests on one storm (Source 1, paragraph 1), and Baker's evidence is matched by a forecast of rain made beforehand (Source 2, paragraph 5). The critics were more credible on evidence, using independent maps and observers, but some of their claims went too far: Sanford calls all rain-makers frauds on the strength of "a local example" (Source 3), and his San Antonio summary omits rain that Macfarlane heard at 1.30 (Source 8, paragraph 5). Rubric: full credit for an audit of a claim and of evidence on each side with citations and a clear judgment; partial credit if one side is audited only loosely. Either judgment may be defended.
Question 19 of 20 · Short Answer
Rewrite the claim in Source 7A so that it is credible, using only Sources 7B-7E. Include the change in downtown sales-tax receipts from Source 7C as a percentage.
Model answer: "Downtown sales-tax receipts were about 6% higher this June than last June ($410,000 against $386,800), and four market sellers reported 25% more sales in June than in May; better June weather and other causes may explain part of the rise, and at least one business, a bakery, lost Friday sales." Rubric: full credit for a claim that uses the 6% figure correctly, limits the 25% figure to the four shops, and names an alternative explanation or a counterexample; partial credit for two of the three.
Question 20 of 20 · Short Answer
Before voting to pay for the market again, what evidence should the council ask for? Name two kinds of evidence and explain which weakness in Sources 7A-7E each would fix.
Model answer: First, sales for all downtown businesses on market Fridays compared with other Fridays in June, which fixes the selection problem of Source 7B and separates the market from the season. Second, a count or survey of how many market visitors also shopped downtown, collected by someone without a stake, which tests the organizers' claim directly instead of relying on their report. Rubric: full credit for two kinds of evidence, each tied to a named weakness; partial credit for one.
0 of 20 answered · 0 correct
06
Frequently Asked Questions
10 Questions
What does D4.4.9-12 mean?
D4.4.9-12 asks high school students to critique how arguments use claims and evidence, judging their credibility. Students test whether each claim stays within what its maker could know and show, and whether the evidence is relevant, independent, sufficient and fairly selected.
What is the difference between D4.4.6-8 and D4.4.9-12?
Grades 6-8 critique whole arguments for credibility. Grades 9-12 take the argument apart and critique the use of its claims and of its evidence separately, including the critics' arguments.
What does "the use of claims" mean in D4.4.9-12?
It means how an arguer states and stretches a claim: its scope, its certainty, whether the arguer could know it, and whether any result could count against it. A claim can be stated so broadly that no evidence could ever test it.
What does "the use of evidence" mean?
It means how an arguer selects and presents evidence: whether it bears on the claim, who collected it, whether there is enough of it, what else could explain it, and what was left out. The same fact can be used credibly or selectively.
Why use 1890s rain-making for D4.4.9-12?
The debate is documented, it is not a current partisan issue, and both sides made strong claims. Students can catch the rain-makers confusing rain after an action with rain because of it, and catch a critic overgeneralizing. The topic is a vehicle for the skill.
Does the lesson say who was right about rain-making?
The lesson asks students to judge the credibility of claims and evidence in the sources, not to decide the science from later knowledge. The rubric scores the audit and the fairness of the judgment.
How should students handle insults in historical sources?
Treat them as claims that need evidence. When Sanford calls rain-makers "fakirs" or Macfarlane calls them "cranks", students ask what evidence supports the label and whether it applies to everyone it names.
How is D4.4.9-12 assessed?
It is assessed by having students audit specific claims and specific uses of evidence, cite the sources, and reach a fair overall judgment. Strong answers apply the same tests to both sides of a debate.
Can this lesson be used in an economics or science class?
Yes. The rain-making sources fit earth science and the history of government funding, and the quiz scenario applies the same audit to an economics claim about a city market and downtown sales.
Which standards connect to D4.4.9-12?
It builds on D4.4.6-8 and D3.3.9-12, pairs with RH.11-12.8 and WHST.11-12.1 in literacy, and leads to D4.5.9-12, where students critique the reasoning and details of explanations.
07
Related Standards
5 standards
These standards connect to D4.4.9-12: prerequisites to review first, parallel standards at the same level, and next steps that build on it.
Standard text: National Council for the Social Studies (NCSS), The College, Career, and Civic Life (C3) Framework for Social Studies State Standards: Guidance for Enhancing the Rigor of K-12 Civics, Economics, Geography, and History (Silver Spring, MD: NCSS, 2013). NCSS was not involved in the production of this lesson and does not endorse it.