Guidelines

RAG Test Results — openai/gpt-4o — 2026-03-26 20:56

Instance: fundloans-guidelines-search Model: openai/gpt-4o Mode: Chat Completions Result: 0/22 passed (0%)


Summary

# ID Result Source Found Score Question
1 apex-oo-1 ERROR No What is the maximum LTV for a purchase on an Apex Alt Doc loan with 740 FICO, ow
2 apex-oo-2 ERROR No Can I get a cash-out refinance under Apex with a 660 FICO score and a $1.2 milli
3 apex-inv-1 ERROR No What are the LTV limits for an Apex investor loan with 700 FICO and $2.3 million
4 apex-pnl-1 ERROR No What LTV can I get on an Apex P&L Only loan for $1.8 million with 720 FICO, owne
5 apex-jumbo-1 ERROR No What are the Apex super jumbo LTV limits for a $4.5 million loan with 760 FICO,
6 montage-oo-1 ERROR No What is the max LTV for a Montage Full Doc purchase loan, 720 FICO, $900K, prima
7 montage-inv-1 ERROR No What are the Montage investment property LTV limits for a $1.3 million loan with
8 spectrum-1 ERROR No What is the maximum LTV for a Spectrum DSCR loan with 700 FICO, $1.2 million pur
9 spectrum-noratio-1 ERROR No Can I get a no-ratio DSCR loan under Spectrum with 720 FICO for $1.3 million? Wh
10 spectrum-fn-1 ERROR No What are the LTV limits for a foreign national borrower under the Spectrum DSCR
11 reserves-1 ERROR No How many months of reserves are required for a $600,000 Apex loan?
12 reserves-inv-1 ERROR No What are the reserve requirements for a first-time investor under Apex?
13 cashout-1 ERROR No What is the maximum cash-out amount if my LTV is 65%?
14 fico-min-1 ERROR No What is the minimum FICO score for any FundLoans loan program?
15 max-loan-1 ERROR No What is the maximum loan amount FundLoans will fund?
16 min-loan-1 ERROR No What is the minimum loan amount for a Spectrum DSCR loan?
17 borrower-1 ERROR No Are foreign nationals eligible for FundLoans programs?
18 housing-1 ERROR No What is the minimum housing history requirement for FundLoans?
19 dti-1 ERROR No What is the maximum DTI ratio allowed under FundLoans programs?
20 edge-boundary-1 ERROR No I have a 680 FICO and want a $2 million Apex investment loan. What is my max LTV
21 edge-na-1 ERROR No Can I get a cash-out refinance on a $2.8 million Apex investment property with 6
22 edge-casebycase-1 ERROR No What happens with Apex P&L Only loans over $3 million?

Detailed Results

apex-oo-1 — ERROR

Question: What is the maximum LTV for a purchase on an Apex Alt Doc loan with 740 FICO, owner occupied primary residence, loan amount $800,000?

Expected: 90% LTV

Error: Client error '400 Bad Request' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/400 Tags: apex, owner-occ, ltv


apex-oo-2 — ERROR

Question: Can I get a cash-out refinance under Apex with a 660 FICO score and a $1.2 million loan amount on my primary residence?

Expected: 75% max LTV for cash out

Error: Client error '400 Bad Request' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/400 Tags: apex, owner-occ, cashout


apex-inv-1 — ERROR

Question: What are the LTV limits for an Apex investor loan with 700 FICO and $2.3 million loan amount?

Expected: 75% purchase/RT refi, 65% cash out

Error: Client error '400 Bad Request' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/400 Tags: apex, investor, ltv


apex-pnl-1 — ERROR

Question: What LTV can I get on an Apex P&L Only loan for $1.8 million with 720 FICO, owner occupied?

Expected: 75% purchase/RT refi, 65% cash out

Error: Client error '400 Bad Request' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/400 Tags: apex, pnl, ltv


apex-jumbo-1 — ERROR

Question: What are the Apex super jumbo LTV limits for a $4.5 million loan with 760 FICO, owner occupied?

Expected: 65% purchase, 60% RT refi, 55% cash out

Error: Client error '400 Bad Request' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/400 Tags: apex, super-jumbo, ltv


montage-oo-1 — ERROR

Question: What is the max LTV for a Montage Full Doc purchase loan, 720 FICO, $900K, primary residence?

Expected: 85% LTV

Error: Client error '400 Bad Request' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/400 Tags: montage, owner-occ, ltv


montage-inv-1 — ERROR

Question: What are the Montage investment property LTV limits for a $1.3 million loan with 680 FICO?

Expected: 80% purchase/RT refi, 70% cash out

Error: Client error '400 Bad Request' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/400 Tags: montage, investor, ltv


spectrum-1 — ERROR

Question: What is the maximum LTV for a Spectrum DSCR loan with 700 FICO, $1.2 million purchase, DSCR >= 1.00?

Expected: 75% purchase

Error: Client error '400 Bad Request' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/400 Tags: spectrum, dscr, ltv


spectrum-noratio-1 — ERROR

Question: Can I get a no-ratio DSCR loan under Spectrum with 720 FICO for $1.3 million? What are the LTV limits?

Expected: 65% purchase, 65% rate/term, 60% cash out

Error: Client error '400 Bad Request' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/400 Tags: spectrum, no-ratio, ltv


spectrum-fn-1 — ERROR

Question: What are the LTV limits for a foreign national borrower under the Spectrum DSCR program?

Expected: 65% purchase, 65% rate/term, 60% cash out for loans up to $1.5MM

Error: Client error '400 Bad Request' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/400 Tags: spectrum, foreign-national, ltv


reserves-1 — ERROR

Question: How many months of reserves are required for a $600,000 Apex loan?

Expected: 6 months (>$500k-$1.5MM tier)

Error: Client error '400 Bad Request' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/400 Tags: reserves


reserves-inv-1 — ERROR

Question: What are the reserve requirements for a first-time investor under Apex?

Expected: 12 months

Error: Client error '400 Bad Request' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/400 Tags: reserves, investor


cashout-1 — ERROR

Question: What is the maximum cash-out amount if my LTV is 65%?

Expected: $1.5MM (over 60% LTV cap is $1.5MM)

Error: Client error '400 Bad Request' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/400 Tags: cashout


fico-min-1 — ERROR

Question: What is the minimum FICO score for any FundLoans loan program?

Expected: 660 for Apex and Montage, 660 for Spectrum

Error: Client error '400 Bad Request' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/400 Tags: fico, eligibility


max-loan-1 — ERROR

Question: What is the maximum loan amount FundLoans will fund?

Expected: $6,000,000

Error: Client error '400 Bad Request' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/400 Tags: loan-amount


min-loan-1 — ERROR

Question: What is the minimum loan amount for a Spectrum DSCR loan?

Expected: $200,000 (Spectrum min is $200K vs $300K for Apex/Montage)

Error: Client error '400 Bad Request' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/400 Tags: spectrum, loan-amount


borrower-1 — ERROR

Question: Are foreign nationals eligible for FundLoans programs?

Expected: Only under the DSCR/Spectrum program

Error: Client error '400 Bad Request' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/400 Tags: eligibility, foreign-national


housing-1 — ERROR

Question: What is the minimum housing history requirement for FundLoans?

Expected: 12 months minimum, 0x30x12 (no 30-day lates in 12 months)

Error: Client error '400 Bad Request' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/400 Tags: credit, housing


dti-1 — ERROR

Question: What is the maximum DTI ratio allowed under FundLoans programs?

Expected: 50% max DTI

Error: Client error '400 Bad Request' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/400 Tags: dti


edge-boundary-1 — ERROR

Question: I have a 680 FICO and want a $2 million Apex investment loan. What is my max LTV for a purchase?

Expected: 75% (>$1.5MM to $2MM tier, 680 FICO row) for purchase/RT refi

Error: Client error '400 Bad Request' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/400 Tags: apex, edge-case, boundary


edge-na-1 — ERROR

Question: Can I get a cash-out refinance on a $2.8 million Apex investment property with 680 FICO?

Expected: Not eligible (N/A) — cash out not available at that FICO/loan amount combination

Error: Client error '400 Bad Request' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/400 Tags: apex, edge-case, not-eligible


edge-casebycase-1 — ERROR

Question: What happens with Apex P&L Only loans over $3 million?

Expected: Case-by-case review required; all loans >$4MM require prior submission review

Error: Client error '400 Bad Request' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/400 Tags: apex, edge-case, case-by-case


Pass Rate by Category

Tag Pass Rate Passed/Total
apex 0% 0/8
owner-occ 0% 0/3
ltv 0% 0/9
cashout 0% 0/2
investor 0% 0/3
pnl 0% 0/1
super-jumbo 0% 0/1
montage 0% 0/2
spectrum 0% 0/4
dscr 0% 0/1
no-ratio 0% 0/1
foreign-national 0% 0/2
reserves 0% 0/2
fico 0% 0/1
eligibility 0% 0/2
loan-amount 0% 0/2
credit 0% 0/1
housing 0% 0/1
dti 0% 0/1
edge-case 0% 0/3
boundary 0% 0/1
not-eligible 0% 0/1
case-by-case 0% 0/1