Share-based Payment Arrangement [Abstract] Schedule of Share-based Compensation Arrangements by Share-based Payment Award [Table] Schedule of Share-based Compensation Arrangements by Share-based Payment Award [Table] Share Repurchase Program [Axis] Share Repurchase Program [Axis] Share Repurchase Program [Domain] Share Repurchase Program [Domain] Previous Authorized Stock Repurchase Program Previous Authorized Program [Member] Previous Authorized Program [Member] Current Authorized Stock Repurchase Program Current Authorized Program [Member] Current Authorized Program [Member] Class of Stock [Axis] Class of Stock [Axis] Class of Stock [Domain] Class of Stock [Domain] Common Stock Common Stock [Member] Award Type [Axis] Award Type [Axis] Award Type [Domain] Award Type [Domain] RSUs Restricted Stock Units (RSUs) [Member] Title of Individual [Axis] Title of Individual [Axis] Title of Individual [Domain] Title of Individual [Domain] Employees and Directors Employees and Directors [Member] Employees and Directors CEO Chief Executive Officer [Member] Vesting [Axis] Vesting [Axis] Vesting [Domain] Vesting [Domain] Anniversary 1 Share-based Payment Arrangement, Tranche One [Member] Anniversary 2 Share-based Payment Arrangement, Tranche Two [Member] Anniversary 3 Share-based Payment Arrangement, Tranche Three [Member] Anniversary 4 Share-based Compensation Award, Tranche Four [Member] Share-based Compensation Award, Tranche Four Stock Award Compensation Expense Share-based Compensation Arrangement by Share-based Payment Award [Line Items] Stock repurchase program, maximum amount authorized Stock Repurchase Program, Authorized Amount Remaining amount under board authorization Stock Repurchase Program, Remaining Authorized Repurchase Amount Restricted stock grants (in shares) Share-based Compensation Arrangement by Share-based Payment Award, Equity Instruments Other than Options, Grants in Period Vesting period for restricted stock grants Share-based Compensation Arrangement by Share-based Payment Award, Award Vesting Period Vesting percentage for restricted stock grants Restricted Share Grants, Annual Vesting Percentage Restricted Share Grants, Annual Vesting Percentage Stock award expense Share-based Payment Arrangement, Expense Income tax benefit from stock award expense Share-based Payment Arrangement, Expense, Tax Benefit Unrecognized compensation expense related to non-vested awards Share-based Payment Arrangement, Nonvested Award, Cost Not yet Recognized, Amount Total fair value of shares vested in the period Share-based Compensation Arrangement by Share-based Payment Award, Equity Instruments Other than Options, Vested in Period, Fair Value Fair Value Disclosures [Abstract] Fair Value, Recurring and Nonrecurring [Table] Fair Value, Recurring and Nonrecurring [Table] Measurement Frequency [Axis] Measurement Frequency [Axis] Measurement Frequency [Domain] Measurement Frequency [Domain] Recurring Fair Value, Recurring [Member] Fair Value Hierarchy and NAV [Axis] Fair Value Hierarchy and NAV [Axis] Fair Value, Measurements, Fair Value Hierarchy [Domain] Fair Value Hierarchy and NAV [Domain] Level 3 Fair Value, Inputs, Level 3 [Member] Financial Instrument [Axis] Financial Instrument [Axis] Financial Instruments [Domain] Financial Instruments [Domain] Non-Agency RMBS Non-Agency, Residential Mortgage Backed Securities [Member] Non-Agency, Residential Mortgage Backed Securities [Member] Mortgage Servicing Rights Mortgage Servicing Rights [Member] Mortgage Servicing Rights [Member] Derivative Instruments, net Derivative Financial Instruments, Assets [Member] Income Statement Location [Axis] Income Statement Location [Axis] Income Statement Location [Domain] Income Statement Location [Domain] Included in earnings—Sale of securities Sale Of Mortgage-backed Securities [Member] Sale Of Mortgage-backed Securities [Member] Included in earnings—Mortgage banking income Mortgage Banking [Member] Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items] Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items] Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation, Calculation [Roll Forward] Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation, Calculation [Roll Forward] Opening Balance Fair Value, Measurement with Unobservable Inputs Reconciliation, Recurring Basis, Asset Value Total gains or losses for the period - Included in earnings Fair Value, Measurement with Unobservable Inputs Reconciliation, Recurring Basis, Asset, Gain (Loss) Included in Earnings Total gains or losses for the period - Included in other comprehensive income Fair Value, Measurement with Unobservable Inputs Reconciliation, Recurring Basis, Asset, Gain (Loss) Included in Other Comprehensive Income (Loss) Purchases, originations, issues, sales and settlements: Fair Value, Measurement with Unobservable Inputs Reconciliation, Recurring Basis, Asset, Purchases, (Sales), Issuances, (Settlements) [Abstract] Purchases/originations Fair Value, Measurement with Unobservable Inputs Reconciliation, Recurring Basis, Asset, Purchases Sales Fair Value, Measurement with Unobservable Inputs Reconciliation, Recurring Basis, Asset, Sales Settlements Fair Value, Measurement with Unobservable Inputs Reconciliation, Recurring Basis, Asset, Settlements Closing balance Change in unrealized gains or losses for the period included in earnings for assets held at the end of the reporting period Fair Value, Measurement with Unobservable Inputs Reconciliation, Recurring Basis, Asset, Period Increase (Decrease) Revenue from Contract with Customer [Abstract] Disaggregation of Revenue [Table] Disaggregation of Revenue [Table] Product and Service [Axis] Product and Service [Axis] Product and Service [Domain] Product and Service [Domain] Deposit service fees Deposit Service Fees [Member] Deposit Service Fees Card fees Card Fees [Member] Card Fees Broker-dealer clearing fees Broker Dealer Clearing Fees [Member] Broker Dealer Clearing Fees [Member] Bankruptcy trustee and fiduciary service fees Bankruptcy Trustees and Fiduciary Service Fees [Member] Bankruptcy Trustees and Fiduciary Service Fees Disaggregation of Revenue [Line Items] Disaggregation of Revenue [Line Items] Non-interest income (in-scope of Topic 606) Revenue from Contract with Customer, Excluding Assessed Tax Non-interest income (out-of-scope of Topic 606) Noninterest Income, Other Than Revenue from Contract with Customer Excluding Assessed Tax Noninterest Income, Other Than Revenue from Contract with Customer Excluding Assessed Tax Total non-interest income Noninterest Income Receivables [Abstract] Financing Receivable, Credit Quality Indicator [Table] Financing Receivable, Credit Quality Indicator [Table] Internal Credit Assessment [Axis] Internal Credit Assessment [Axis] Internal Credit Assessment [Domain] Internal Credit Assessment [Domain] Pass Pass [Member] Special Mention Special Mention [Member] Substandard Substandard [Member] Doubtful Doubtful [Member] Class of Financing Receivable [Axis] Class of Financing Receivable [Axis] Class of Financing Receivable [Domain] Class of Financing Receivable [Domain] Mortgage Residential Mortgage [Member] Warehouse Warehouse Loans [Member] Warehouse Loans [Member] Financing Financing Loan [Member] Financing Loan [Member] Multifamily secured - mortgage and financing Residential Multifamily Loan [Member] Residential Multifamily Loan [Member] Commercial real estate secured - mortgage Real Estate [Member] Auto and RV secured Automobile Loan [Member] Commercial & Industrial Commercial and Industrial [Member] Commercial and Industrial Other Other Loan [Member] Other Loan [Member] Loan Source [Axis] Loan Source [Axis] Loan Source [Axis] Source of Loan Origination [Domain] Source of Loan Origination [Domain] Source of Loan Origination [Domain] In-house originated In-house Originated Loans [Member] Loans underwritten directly by the Company. Purchased Purchased Loans [Member] Purchased Loans [Member] Financing Receivable, Credit Quality Indicator [Line Items] Financing Receivable, Credit Quality Indicator [Line Items] Total gross loans and leases Loans and Leases Receivable, Gross As a % of total gross loans and leases Loans and Leases Receivable, Ratio of Grade Class to Gross Loans Loans and Leases Receivable, Ratio of Grade Class to Gross Loans Statement of Stockholders' Equity [Abstract] Statement [Table] Statement [Table] Equity Components [Axis] Equity Components [Axis] Equity Component [Domain] Equity Component [Domain] Preferred Stock Preferred Stock [Member] Treasury Treasury Stock [Member] Additional Paid-in Capital Additional Paid-in Capital [Member] Retained Earnings Retained Earnings [Member] Accumulated Other Comprehensive Income (Loss), Net of Income Tax AOCI Attributable to Parent [Member] Statement [Line Items] Statement [Line Items] Increase (Decrease) in Stockholders' Equity [Roll Forward] Increase (Decrease) in Stockholders' Equity [Roll Forward] Preferred stock, beginning balance (in shares) Preferred Stock, Shares Outstanding Stockholder's equity, beginning balance Stockholders' Equity Attributable to Parent Common stock, issued, beginning balance (in shares) Common Stock, Shares, Issued Common stock, treasury and outstanding, beginning balance (in shares) Common Stock, Shares, Outstanding Net income Net Income (Loss) Attributable to Parent Other comprehensive income (loss) Other Comprehensive Income (Loss), Net of Tax, Portion Attributable to Parent Cash dividends on preferred stock Dividends, Preferred Stock, Cash Stock-based compensation expense and restricted stock unit vesting and tax benefits, issued (in shares) Stock Issued During Period, Shares, Restricted Stock Award, Gross Stock-based compensation expense and restricted stock unit vesting and tax benefits, treasury (in shares) Share-based Payment Arrangement, Shares Withheld for Tax Withholding Obligation Restricted stock unit vesting and tax benefits, outstanding (in shares) Stock Issued During Period, Shares, Restricted Stock Award, Net of Forfeitures Stock-based compensation expense and restricted stock unit vesting Share-based Compensation, Requisite Service Period Recognition and Stock Issued During Period, Value, Restricted Stock Award, Net of Forfeitures Share-based Compensation, Requisite Service Period Recognition and Stock Issued During Period, Value, Restricted Stock Award, Net of Forfeitures Preferred stock, ending balance (in shares) Stockholder's equity, ending balance Common stock, issued, ending balance (in shares) Common stock, treasury and outstanding, ending balance (in shares) Investments, Debt and Equity Securities [Abstract] Other than Temporary Impairment, Credit Losses Recognized in Earnings [Roll Forward] Other than Temporary Impairment, Credit Losses Recognized in Earnings [Roll Forward] Beginning balance Other than Temporary Impairment, Credit Losses Recognized in Earnings, Credit Losses on Debt Securities Held Additions for the amounts related to the credit loss for which an other-than-temporary impairment was not previously recognized Other than Temporary Impairment, Credit Losses Recognized in Earnings, Additions, No Previous Impairment Increases to the amount related to the credit loss for which other-than-temporary impairment was previously recognized Other than Temporary Impairment, Credit Losses Recognized in Earnings, Additions, Additional Credit Losses Credit losses realized for securities sold Other than Temporary Impairment, Credit Losses Recognized in Earnings, Reductions, Securities Sold Ending balance Schedule of Assets and Liabilities Measured at Fair Value on Recurring Basis Schedule of Fair Value, Assets and Liabilities Measured on Recurring Basis [Table Text Block] Schedule of Additional Information About Assets Measured at Fair Value on a Recurring Basis and for which the Company has Utilized Level 3 Inputs to Determine Fair Value Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation [Table Text Block] Schedule of Quantitative Information About Level 3 Fair Value Measurements Fair Value Measurement Inputs and Valuation Techniques [Table Text Block] Schedule of Fair Value Assets Measured on Nonrecurring Basis Fair Value Measurements, Nonrecurring [Table Text Block] Schedule of Aggregate Fair Value, Contractual Balance, and Gains of Loans Held For Sale Fair Value, Loans Held For Sale [Table Text Block] Fair Value, Loans Held For Sale [Table Text Block] Schedule of Carrying Amounts and Estimated Fair Values of Financial Instruments at Period-end Fair Value, by Balance Sheet Grouping [Table Text Block] Available-for-sale debt securities—net unrealized gains (losses) Accumulated Other Comprehensive Income (Loss), Other than Temporary Impairment, Available-for-sale, Debt Securities, Net Unrealized Gains Accumulated Other Comprehensive Income (Loss), Other than Temporary Impairment, Available-for-sale, Debt Securities, Net Unrealized Gains Available-for-sale debt securities—non-credit related losses Accumulated Other Comprehensive Income (Loss), Other than Temporary Impairment, Not Credit Loss, Before Tax, Available-for-Sale, Debt Securities Accumulated Other Comprehensive Income (Loss), Other than Temporary Impairment, Not Credit Loss, Before Tax, Available-for-Sale, Debt Securities Subtotal Accumulated Other Comprehensive Income (Loss), Investment Securities, Before Tax Accumulated Other Comprehensive Income (Loss), Investment Securities, Before Tax Tax (expense) benefit Accumulated Other Comprehensive Income (Loss), Investment Securities, Tax Expense (Benefit) Accumulated Other Comprehensive Income (Loss), Investment Securities, Tax Expense (Benefit) Net unrealized gain (loss) on investment securities in accumulated other comprehensive income (loss) Accumulated Other Comprehensive Income (Loss), Investment Securities, Net of Tax Accumulated Other Comprehensive Income (Loss), Investment Securities, Net of Tax Financing Receivable, Allowance for Credit Loss [Table] Financing Receivable, Allowance for Credit Loss [Table] Financing Receivable, Allowance for Credit Loss [Line Items] Financing Receivable, Allowance for Credit Loss [Line Items] Individually evaluated for impairment – general allowance Financing Receivable, Allowance for Credit Losses, Individually Evaluated for Impairment, General Allowance Financing Receivable, Allowance for Credit Losses, Individually Evaluated for Impairment, General Allowance Individually evaluated for impairment – specific allowance Financing Receivable, Allowance for Credit Losses, Individually Evaluated for Impairment, Specific Allowance Financing Receivable, Allowance for Credit Losses, Individually Evaluated for Impairment, Specific Allowance Collectively evaluated for impairment Financing Receivable, Allowance for Credit Losses, Collectively Evaluated for Impairment Total ending allowance balance Financing Receivable, Allowance for Credit Loss Loans and leases individually evaluated for impairment Financing Receivable, Individually Evaluated for Impairment Loans and leases collectively evaluated for impairment Financing Receivable, Collectively Evaluated for Impairment Principal loan and lease balance Unaccreted discounts and loan and lease fees Unamortized Loan Commitment and Origination Fees and Unamortized Discounts or Premiums Total recorded investment in loans and leases Loans and Leases Receivable, Recorded Investment, Net of Accrued Interest, Unaccreted Discounts and Fees Loans and Leases Receivable, Recorded Investment, Net of Accrued Interest, Unaccreted Discounts and Fees Threshold period for TDRs to be considered performing Loans and Leases Receivable, Threshold Period For Troubled Debt Restructurings (TDRs) To Be Considered Performing Loans and Leases Receivable, Threshold Period For Troubled Debt Restructurings (TDRs) To Be Considered Performing Schedule of Unrecognized Compensation Expense Related to Non-vested Awards To be Recognized in the Future Share-based Payment Arrangement, Nonvested Award, Cost [Table Text Block] Schedule of Status and Changes in Restricted Stock Grants Share-based Payment Arrangement, Restricted Stock and Restricted Stock Unit, Activity [Table Text Block] Statement of Cash Flows [Abstract] CASH FLOWS FROM OPERATING ACTIVITIES: Net Cash Provided by (Used in) Operating Activities [Abstract] Adjustments to reconcile net income to net cash provided by (used in) operating activities: Adjustments to Reconcile Net Income (Loss) to Cash Provided by (Used in) Operating Activities [Abstract] Net accretion on securities and loans and leases Amortization (Accretion) of Premiums (Discounts), Loans The net increase(decrease) in interest income during the period representing the allocation of premiums or discounts on originated loans. Amortization of borrowing costs Amortization of Debt Issuance Costs Amortization of operating lease right of use asset Operating Lease, Right-of-Use Asset, Amortization Operating Lease, Right-of-Use Asset, Amortization Stock-based compensation expense Share-based Payment Arrangement, Noncash Expense Net (gain) loss on sale of investment securities Gain (Loss) on Sale of Investments Provision for loan and lease losses Provision for Loan and Lease Losses Deferred income taxes Deferred Income Tax Expense (Benefit) Origination of loans held for sale Payments for Origination and Purchases of Loans Held-for-sale Unrealized (gain) loss on loans held for sale Unrealized Gain Loss On Loans Held For Sale Unrealized Gain Loss On Loans Held For Sale Gain on sales of loans held for sale Gain On Sales Of Loans Held For Sale Gain On Sales Of Loans Held For Sale Proceeds from sale of loans held for sale Proceeds from Sale of Loans Held-for-sale Change in fair value of mortgage servicing rights Mortgage Servicing Rights (MSR) Impairment (Recovery) (Gain) loss on sale of other real estate and foreclosed assets Gains (Losses) On Sale Of Other Real Estate And Foreclosed Assets Gains (Losses) On Sale Of Other Real Estate And Foreclosed Assets Depreciation and amortization Depreciation, Depletion and Amortization Net changes in assets and liabilities which provide (use) cash: Increase (Decrease) in Operating Capital [Abstract] Accrued interest receivable Increase (Decrease) in Accrued Interest Receivable, Net Securities borrowed Increase (Decrease) in Securities Borrowed Customer, broker-dealer and clearing receivables Increase (Decrease) in Receivables from Brokers-Dealers and Clearing Organizations Other assets Increase (Decrease) in Other Operating Assets Accrued interest payable Increase (Decrease) in Interest Payable, Net Securities loaned Increase (Decrease) in Securities Loaned Transactions Customer, broker-dealer and clearing payables Increase (Decrease) in Payables to Broker-Dealers and Clearing Organizations Accounts payable and other liabilities Increase (Decrease) in Other Accounts Payable and Accrued Liabilities Net cash provided by (used in) operating activities Net Cash Provided by (Used in) Operating Activities CASH FLOWS FROM INVESTING ACTIVITIES: Net Cash Provided by (Used in) Investing Activities [Abstract] Purchases of investment securities Payments to Acquire Marketable Securities Proceeds from sales of securities Proceeds from Sale of Debt Securities, Available-for-sale Proceeds from repayment of securities Proceeds From Repayment Of Securities Proceeds From Repayment Of Securities Purchase of stock of regulatory agencies Payments To Acquire Regulatory Agencies Stock Payments To Acquire Regulatory Agencies Stock Proceeds from redemption of stock of regulatory agencies Proceeds From Sale Of Regulatory Agencies Stock Proceeds From Sale Of Regulatory Agencies Stock Origination of loans and leases held for investment Origination Of Loans Net Origination Of Loans Net Proceeds from sale of loans and leases held for investment Proceeds from Sale of Loans and Leases Held-for-investment Origination of mortgage warehouse loans, net Payments for Origination of Mortgage Loans Held-for-sale Proceeds from sales of other real estate owned and repossessed assets Proceeds from Sale of Foreclosed Assets Principal repayments on loans and leases Proceeds from Principal Repayments on Loans and Leases Held-for-investment Purchases of furniture, equipment and software Payments to Acquire Productive Assets Net cash used in investing activities Net Cash Provided by (Used in) Investing Activities CASH FLOWS FROM FINANCING ACTIVITIES: Net Cash Provided by (Used in) Financing Activities [Abstract] Net increase (decrease) in deposits Increase (Decrease) in Deposits Proceeds from the Federal Home Loan Bank term advances Proceeds from FHLBank Borrowings, Financing Activities Repayment of the Federal Home Loan Bank term advances Payments of FHLBank Borrowings, Financing Activities Net (repayment) proceeds of Federal Home Loan Bank other advances Proceeds From (Repayments Of) Federal Home Loan Bank, Other Advances Proceeds From (Repayments Of) Federal Home Loan Bank, Other Advances Repayments of borrowings Proceeds from (Payments for) in Securities Sold under Agreements to Repurchase Tax payments related to settlement of restricted stock units Payment, Tax Withholding, Share-based Payment Arrangement Cash dividends paid on preferred stock Payments of Ordinary Dividends, Preferred Stock and Preference Stock Net cash provided by financing activities Net Cash Provided by (Used in) Financing Activities NET CHANGE IN CASH AND CASH EQUIVALENTS Cash, Cash Equivalents, Restricted Cash and Restricted Cash Equivalents, Period Increase (Decrease), Including Exchange Rate Effect CASH AND CASH EQUIVALENTS—Beginning of year Cash, Cash Equivalents, Restricted Cash and Restricted Cash Equivalents CASH AND CASH EQUIVALENTS—End of period SUPPLEMENTAL DISCLOSURE OF CASH FLOW INFORMATION: Supplemental Cash Flow Information [Abstract] Interest paid on deposits and borrowed funds Interest Paid, Excluding Capitalized Interest, Operating Activities Income taxes paid Income Taxes Paid Transfers to other real estate and repossessed vehicles Transfers To Other Real Estate And Repossessed Vehicles Transfers To Other Real Estate And Repossessed Vehicles Transfers from loans and leases held for investment to loans held for sale Transfer of Portfolio Loans and Leases to Held-for-sale Loans and leases held for investment sold, cash not received Sale Of Loans, Cash Not Received Sale Of Loans, Cash Not Received Operating lease liabilities for obtaining right of use assets Operating Lease Liability, Obtained In Exchange For Right Of Use Asset Operating Lease Liability, Obtained In Exchange For Right Of Use Asset Proceeds Gross realized gains Debt Securities, Available-for-sale, Realized Gain Gross realized losses Debt Securities, Available-for-sale, Realized Loss Net realized gain (loss) on securities Debt Securities, Available-for-sale, Realized Gain (Loss) With no related allowance recorded: Financing Receivable, Evaluated Individually For Impairment, With No Related Allowance Recorded [Abstract] Financing Receivable, Evaluated Individually For Impairment, With No Related Allowance Recorded [Abstract] Unpaid Principal Balance Financing Receivable, with No Related Allowance, Unpaid Principal Balance, Individually Evaluated for Impairment Financing Receivable, with No Related Allowance, Unpaid Principal Balance, Individually Evaluated for Impairment Principal Balance Adjustment Financing Receivable, with No Related Allowance, Charge-off, Individually Evaluated for Impairment Financing Receivable, with No Related Allowance, Charge-off, Individually Evaluated for Impairment Recorded Investment Financing Receivable, with No Related Allowance, Unpaid Book Balance, Individually Evaluated for Impairment Financing Receivable, with No Related Allowance, Unpaid Book Balance, Individually Evaluated for Impairment Accrued Interest / Origination Fees Financing Receivable, with No Related Allowance, Accrued Interest and Origination Fees, Individually Evaluated for Impairment Financing Receivable, with No Related Allowance, Accrued Interest and Origination Fees, Individually Evaluated for Impairment Total Impaired Financing Receivable, with No Related Allowance, Recorded Investment, Individually Evaluated for Impairment, including Accrued Interest and Unaccreted Discounts and Loan Fees Impaired Financing Receivable, with No Related Allowance, Recorded Investment, Individually Evaluated for Impairment, including Accrued Interest and Unaccreted Discounts and Loan Fees With an allowance recorded: Financing Receivable, Evaluated Individually For Impairment, With Related Allowance Recorded [Abstract] Financing Receivable, Evaluated Individually For Impairment, With Related Allowance Recorded [Abstract] Unpaid Principal Balance Financing Receivable, with Related Allowance, Unpaid Principal Balance, Individually Evaluated for Impairment Financing Receivable, with Related Allowance, Unpaid Principal Balance, Individually Evaluated for Impairment Principal Balance Adjustment Financing Receivable, with Related Allowance, Charge-off, Individually Evaluated for Impairment Financing Receivable, with Related Allowance, Charge-off, Individually Evaluated for Impairment Recorded Investment Financing Receivable, with Related Allowance, Unpaid Book Balance, Individually Evaluated for Impairment Financing Receivable, with Related Allowance, Unpaid Book Balance, Individually Evaluated for Impairment Accrued Interest / Origination Fees Financing Receivable, with Related Allowance, Accrued Interest and Origination Fees, Individually Evaluated for Impairment Financing Receivable, with Related Allowance, Accrued Interest and Origination Fees, Individually Evaluated for Impairment Total Impaired Financing Receivable, with Related Allowance, Recorded Investment, Individually Evaluated for Impairment, including Accrued Interest and Unaccreted Discounts and Loan Fees Impaired Financing Receivable, with Related Allowance, Recorded Investment, Individually Evaluated for Impairment, including Accrued Interest and Unaccreted Discounts and Loan Fees Related Allocation of General Allowance Impaired Financing Receivable, Related General Allowance Impaired Financing Receivable, Related General Allowance Related Allocation of Specific Allowance Impaired Financing Receivable, Related Specific Allowance Impaired Financing Receivable, Related Specific Allowance As a % of total gross loans and leases Financing Receivable, Evaluated Individually For Impairment As a Percentage of Gross Loans [Abstract] Financing Receivable, Evaluated Individually For Impairment As a Percentage of Gross Loans [Abstract] Unpaid Principal Balance Financing Receivable, Unpaid Principal Balance, Individually Evaluated for Impairment, Ratio to All Loans Financing Receivable, Unpaid Principal Balance, Individually Evaluated for Impairment, Ratio to All Loans Principal Balance Adjustment Financing Receivable, Charge-off, Individually Evaluated for Impairment, Ratio to All Loans Financing Receivable, Charge-off, Individually Evaluated for Impairment, Ratio to All Loans Recorded Investment Financing Receivable, Unpaid Book Balance, Individually Evaluated for Impairment, Ratio to All Loans Financing Receivable, Unpaid Book Balance, Individually Evaluated for Impairment, Ratio to All Loans Accrued Interest / Origination Fees Financing Receivable, Accrued Interest and Origination Fees, Individually Evaluated for Impairment, Ratio to All Loans Financing Receivable, Accrued Interest and Origination Fees, Individually Evaluated for Impairment, Ratio to All Loans Total Impaired Financing Receivable, Recorded Investment, Individually Evaluated for Impairment, including Accrued Interest and Unaccreted Discounts and Loan Fees, Ratio to All Loans Impaired Financing Receivable, Recorded Investment, Individually Evaluated for Impairment, including Accrued Interest and Unaccreted Discounts and Loan Fees, Ratio to All Loans Related Allocation of General Allowance Impaired Financing Receivable, Related General Allowance, Ratio to Gross Loans Impaired Financing Receivable, Related General Allowance, Ratio to Gross Loans Related Allocation of Specific Allowance Impaired Financing Receivable, Related Specific Allowance, Ratio to Gross Loans Impaired Financing Receivable, Related Specific Allowance, Ratio to Gross Loans Schedule of Impaired Financing Receivable [Table] Schedule of Impaired Financing Receivable [Table] Financial Instrument Performance Status [Axis] Financial Instrument Performance Status [Axis] Financial Instrument Performance Status [Domain] Financial Instrument Performance Status [Domain] Nonaccrual Nonperforming Financial Instruments [Member] Statistical Measurement [Axis] Statistical Measurement [Axis] Statistical Measurement [Domain] Statistical Measurement [Domain] Minimum Minimum [Member] Maximum Maximum [Member] Financing Receivable, Impaired [Line Items] Financing Receivable, Impaired [Line Items] Ratio of nonaccrual loans and leases considered TDRs Loans and Leases Receivable, Ratio of Nonperforming Loans Considered TDRs Loans and Leases Receivable, Ratio of Nonperforming Loans Considered TDRs Period over which borrowers can make timely payments after TDR considered non-performing Loans and Leases Receivable, TDRs with Timely Payments Considered Nonperforming, Term Loans and Leases Receivable, TDRs with Timely Payments Considered Nonperforming, Term Ratio of nonaccrual loans and leases that are single family mortgage Loans and Leases Receivable, Ratio of Portfolio Segment to Nonperforming Loans Loans and Leases Receivable, Ratio of Portfolio Segment to Nonperforming Loans Percentage of aggregate single family first mortgage loans and leases written down Loans and Leases Receivable, Value after Write-downs of Original Appraised Value, Percent Loans and Leases Receivable, Value after Write-downs of Original Appraised Value, Percent Number or TDRs classified as performing Loans and Leases Receivable, Troubled Debt Restructuring Classified as Performing, Number Loans and Leases Receivable, Troubled Debt Restructuring Classified as Performing, Number Period of delinquent property taxes paid by the borrower Financing Receivable, Modifications, Period of Delinquent Property Taxes Repaid by Borrower Financing Receivable, Modifications, Period of Delinquent Property Taxes Repaid by Borrower Period for interest-only payment made by the borrowers that reverted loan to fully amortizing Financing Receivable, Modifications, Period of Interest-Only Payments Made by Borrowers That Reverted Loan Back To Fully Amortizing Financing Receivable, Modifications, Period of Interest-Only Payments Made by Borrowers That Reverted Loan Back To Fully Amortizing Leases [Abstract] Operating lease right-of-use assets Operating Lease, Right-of-Use Asset Operating lease liabilities Operating Lease, Liability Weighted-average remaining lease term (in years): Weighted Average Remaining Lease Term [Abstract] Weighted Average Remaining Lease Term [Abstract] Operating leases Operating Lease, Weighted Average Remaining Lease Term Weighted-average discount rate: Leases, Weighted Average Discount Rate [Abstract] Leases, Weighted Average Discount Rate [Abstract] Operating leases Operating Lease, Weighted Average Discount Rate, Percent EQUITY AND STOCK-BASED COMPENSATION Share-based Payment Arrangement [Text Block] Income Statement [Abstract] INTEREST AND DIVIDEND INCOME: Interest and Dividend Income, Operating [Abstract] Loans and leases, including fees Interest and Fee Income, Loans and Leases Securities borrowed and customer receivables Interest And Dividend Income, Securities, Borrowed And Customer Receivables Interest And Dividend Income, Securities, Borrowed And Customer Receivables Investments Interest and Dividend Income, Securities, Operating Total interest and dividend income Interest and Dividend Income, Operating INTEREST EXPENSE: Interest Expense [Abstract] Deposits Interest Expense, Deposits Advances from the Federal Home Loan Bank Interest Expense, Federal Home Loan Bank Advances Interest Expense, Federal Home Loan Bank Advances Securities loaned Interest Expense, Securities Loaned Interest Expense, Securities Loaned Other borrowings Interest Expense, Other Total interest expense Interest Expense Net interest income Interest Income (Expense), Net Provision for loan and lease losses Net interest income, after provision for loan and lease losses Interest Income (Expense), after Provision for Loan Loss NON-INTEREST INCOME: Noninterest Income [Abstract] Realized gain (loss) on sale of securities Gain (Loss) on Sales of Mortgage Backed Securities (MBS) Prepayment penalty fee income Prepayment Penalty Fee Income Prepayment Penalty Fee Income Gain on sale – other Gain (Loss) on Disposition of Other Assets Mortgage banking income Fees and Commissions, Mortgage Banking and Servicing Broker-dealer fee income Broker Dealer Fee Income Broker Dealer Fee Income Banking and service fees Banking and Services Fees Banking and Services Fees NON-INTEREST EXPENSE: Noninterest Expense [Abstract] Salaries and related costs Labor and Related Expense Data processing Information Technology and Data Processing Depreciation and amortization Depreciation, Depletion and Amortization, Nonproduction Advertising and promotional Marketing and Advertising Expense Professional services Professional Fees Occupancy and equipment Occupancy And Equipment Expense Occupancy And Equipment Expense FDIC and regulatory fees FDIC and Primary Federal Regulator Fees FDIC and Primary Federal Regulator Fees Broker-dealer clearing charges Floor Brokerage, Exchange and Clearance Fees General and administrative expense Other General and Administrative Expense Total non-interest expense Noninterest Expense INCOME BEFORE INCOME TAXES Income (Loss) from Continuing Operations before Income Taxes, Noncontrolling Interest INCOME TAXES Income Tax Expense (Benefit) NET INCOME NET INCOME ATTRIBUTABLE TO COMMON STOCK Net Income (Loss) Available to Common Stockholders, Basic COMPREHENSIVE INCOME Comprehensive Income (Loss), Net of Tax, Attributable to Parent Basic earnings per common share (in dollars per share) Earnings Per Share, Basic Diluted earnings per common share (in dollars per share) Earnings Per Share, Diluted Commitments and Contingencies Disclosure [Abstract] COMMITMENTS AND CONTINGENCIES Commitments and Contingencies Disclosure [Text Block] REVENUE RECOGNITION Revenue from Contract with Customer [Text Block] Fair Value, by Balance Sheet Grouping [Table] Fair Value, by Balance Sheet Grouping [Table] Level 1 Fair Value, Inputs, Level 1 [Member] Level 2 Fair Value, Inputs, Level 2 [Member] Measurement Basis [Axis] Measurement Basis [Axis] Fair Value Measurement [Domain] Fair Value Measurement [Domain] Portion at Fair Value Measurement Portion at Fair Value Measurement [Member] Carrying Amount Reported Value Measurement [Member] Total Fair Value Estimate of Fair Value Measurement [Member] Fair Value, Balance Sheet Grouping, Financial Statement Captions [Line Items] Fair Value, Balance Sheet Grouping, Financial Statement Captions [Line Items] Financial assets: Assets, Fair Value Disclosure [Abstract] Cash and cash equivalents Cash and Cash Equivalents, Fair Value Disclosure Securities - available-for-sale Debt Securities, Available-for-sale Loans held for sale, at fair value Loans Held-for-sale, Fair Value Disclosure Loans held for sale, lower of cost or fair value Loans Held for Sale, Lower of Cost or Fair Value Loans Held for Sale, Lower of Cost or Fair Value Loans and leases held for investment—net Loans Receivable, Fair Value Disclosure Securities borrowed Securities Borrowed Customer, broker-dealer and clearing receivables Receivables from Brokers-Dealers and Clearing Organizations Accrued interest receivable Accrued Interest Receivable, Fair Value Disclosure Accrued Interest Receivable, Fair Value Disclosure Mortgage servicing rights Servicing Asset at Fair Value, Amount Financial liabilities: Liabilities, Fair Value Disclosure [Abstract] Total deposits Deposits, Fair Value Disclosure Advances from the Federal Home Loan Bank Federal Home Loan Bank Borrowings, Fair Value Disclosure Borrowings, subordinated notes and debentures Subordinated Debt Obligations, Fair Value Disclosure Securities loaned Securities Loaned Customer, broker-dealer and clearing payables Broker-Dealer, Payable to Other Broker-Dealer and Clearing Organization Accrued interest payable Accrued Interest Payable, Fair Value Disclosure Accrued Interest Payable, Fair Value Disclosure Remainder of 2020 Lessee, Operating Lease, Liability, Payments, Remainder of Fiscal Year 2021 Lessee, Operating Lease, Liability, Payments, Due Year Two 2022 Lessee, Operating Lease, Liability, Payments, Due Year Three 2023 Lessee, Operating Lease, Liability, Payments, Due Year Four 2024 Lessee, Operating Lease, Liability, Payments, Due Year Five Thereafter Lessee, Operating Lease, Liability, Payments, Due after Year Five Total lease payments Lessee, Operating Lease, Liability, Payments, Due Less: present value discount Lessee, Operating Lease, Liability, Undiscounted Excess Amount Total Lease Liability Fair Value Measurement Inputs and Valuation Techniques [Table] Fair Value Measurement Inputs and Valuation Techniques [Table] Nonperforming Other real estate owned Real Estate Acquired in Satisfaction of Debt [Member] Nonrecurring Fair Value, Nonrecurring [Member] Fair Value Inputs, Equity, Quantitative Information [Line Items] Fair Value Measurement Inputs and Valuation Techniques [Line Items] Impaired loans, carrying amount Impaired Financing Receivable, Fair Value Disclosure Impaired Financing Receivable, Fair Value Disclosure Impaired loans, charge-offs Financing Receivable, Allowance for Credit Loss, Writeoff Impaired loans, life to date charge-offs Financing Receivable, Allowance for Credit Losses, Write-downs Balance Financing Receivable, Allowance for Credit Losses, Write-downs Balance Impaired loans, life to date payments applied to principal Impaired Financing Receivable, with Related Allowance, Interest Payments Applied to Principal, Cash Basis Method Impaired Financing Receivable, with Related Allowance, Interest Payments Applied to Principal, Cash Basis Method Impaired loans, life to date principal balance adjustments for allowance write-downs Financing Receivable, Allowance for Credit Losses, Aggregate Write-downs Financing Receivable, Allowance for Credit Losses, Aggregate Write-downs Related allowance on impaired loans Impaired Financing Receivable, Related Allowance Other real estate owned and foreclosed assets, fair value Other Real Estate Owned and Foreclosed Assets, Fair Value Disclosure Other Real Estate Owned and Foreclosed Assets, Fair Value Disclosure Statement of Financial Position [Abstract] Series A Preferred Stock Series A Preferred Stock [Member] ASSETS Assets [Abstract] Allowance for loan and lease losses Loans and Leases Receivable, Allowance STOCKHOLDERS’ EQUITY: Stockholders' Equity Attributable to Parent [Abstract] Common stock, par value (in dollars per share) Common Stock, Par or Stated Value Per Share Common stock, shares authorized (in shares) Common Stock, Shares Authorized Common stock, issued (in shares) Common stock, shares outstanding (in shares) Preferred stock, par or stated value (in dollars per share) Preferred Stock, Par or Stated Value Per Share Preferred stock, shares authorized (in shares) Preferred Stock, Shares Authorized Preferred stock, liquidation preference (in dollars per share) Preferred Stock, Liquidation Preference Per Share Preferred stock, shares issued (in shares) Preferred Stock, Shares Issued Preferred stock, shares outstanding (in shares) Treasury stock, at cost (in shares) Treasury Stock, Shares Schedule of Composition of the Loan and Lease Portfolio Schedule of Loans by Loan Portfolio [Table Text Block] Schedule of Loans by Loan Portfolio [Table Text Block] Schedule of Allowance for Credit Losses on Financing Receivables Financing Receivable, Allowance for Credit Loss [Table Text Block] Schedule of Loans and Leases Evaluated for Impairment by Portfolio Class Impaired Financing Receivables [Table Text Block] Schedule of Nonaccrual Loans and Leases Financing Receivable, Nonaccrual [Table Text Block] Schedule of Outstanding Principal Balance on Loans and Leases Performing and Nonaccrual Schedule Of Loans Performing And NonPerforming [Table Text Block] Schedule Of Loans Performing And NonPerforming [Table Text Block] Schedule of Composition of Loan and Lease Portfolio by Credit Quality Indicators Financing Receivable Credit Quality Indicators [Table Text Block] Schedule of Past Due Loan and Leases Financing Receivable, Past Due [Table Text Block] Earnings Per Share [Abstract] Schedule of Calculation of Basic and Diluted EPS Schedule of Earnings Per Share, Basic and Diluted [Table Text Block] Financing Receivable, Past Due [Table] Financing Receivable, Past Due [Table] Financing Receivable, Past Due [Line Items] Financing Receivable, Past Due [Line Items] Total nonaccrual loans secured by real estate Financing Receivable, Recorded Investment, Loans Secured by Real Estate, Nonaccrual Status Financing Receivable, Recorded Investment, Loans Secured by Real Estate, Nonaccrual Status Total nonaccrual loans and leases Financing Receivable, Nonaccrual Nonaccrual loans and leases to total loans and leases Loans and Leases Receivable, Ratio of Nonperforming Loans to All Loans FAIR VALUE Fair Value Disclosures [Text Block] EARNINGS PER COMMON SHARE Earnings Per Share [Text Block] Schedule of Available-for-sale Securities [Table] Schedule of Available-for-sale Securities [Table] Total RMBS securities Residential Mortgage Backed Securities [Member] U.S. agencies Agency, Residential Mortgage Backed Securities [Member] Agency, Residential Mortgage Backed [Member] Non-agency Total Non-RMBS Other Debt Obligations [Member] Municipal debt Municipal Bonds [Member] Asset-backed securities and structured notes Non-Agency Securities [Member] Non-Agency Securities [Member] Debt Securities, Available-for-sale [Line Items] Debt Securities, Available-for-sale [Line Items] Available-for-sale securities in loss position for less than 12 Months, Fair Value Debt Securities, Available-for-sale, Continuous Unrealized Loss Position, Less than 12 Months Available-for-sale securities in loss position for less than 12 Months, Gross Unrealized Losses Debt Securities, Available-for-sale, Continuous Unrealized Loss Position, Less than 12 Months, Accumulated Loss Available-for-sale securities in loss position for more than 12 Months, Fair Value Debt Securities, Available-for-sale, Continuous Unrealized Loss Position, 12 Months or Longer Available-for-sale securities in loss position for more than 12 Months, Fair Value Debt Securities, Available-for-sale, Continuous Unrealized Loss Position, 12 Months or Longer, Accumulated Loss Available-for-sale securities, Fair Value Debt Securities, Available-for-sale, Unrealized Loss Position Available-for-sale securities, Gross Unrealized Losses Debt Securities, Available-for-sale, Unrealized Loss Position, Accumulated Loss Business Combinations [Abstract] Schedule of Business Acquisitions, by Acquisition [Table] Schedule of Business Acquisitions, by Acquisition [Table] Business Acquisition [Axis] Business Acquisition [Axis] Business Acquisition, Acquiree [Domain] Business Acquisition, Acquiree [Domain] Axos Clearing COR Clearing, LLC [Member] COR Clearing, LLC Business Acquisition [Line Items] Business Acquisition [Line Items] Cash and due from banks Business Combination, Recognized Identifiable Assets Acquired and Liabilities Assumed, Cash and Equivalents Cash segregated for regulatory purposes Business Combination, Recognized Identifiable Assets Acquired And Liabilities Assumed, Cash Segregated For Regulatory Purposes Business Combination, Recognized Identifiable Assets Acquired And Liabilities Assumed, Cash Segregated For Regulatory Purposes Securities, available for sale Business Combination, Recognized Identifiable Assets Acquired and Liabilities Assumed, Current Assets, Marketable Securities Stock of the regulatory agencies, at cost Business Combination, Recognized Identifiable Assets Acquired And Liabilities Assumed, Stock Of The Regulatory Agencies Business Combination, Recognized Identifiable Assets Acquired And Liabilities Assumed, Stock Of The Regulatory Agencies Furniture, equipment and software—net Business Combination, Recognized Identifiable Assets Acquired and Liabilities Assumed, Property, Plant, and Equipment Securities borrowed Business Combination, Recognized Identifiable Assets Acquired And Liabilities Assumed, Securities Borrowed Business Combination, Recognized Identifiable Assets Acquired And Liabilities Assumed, Securities Borrowed Customer, broker-dealer and clearing receivables Business Combination, Recognized Identifiable Assets Acquired And Liabilities Assumed, Broker Dealer And Clearing Organization Receivables Business Combination, Recognized Identifiable Assets Acquired And Liabilities Assumed, Broker Dealer And Clearing Organization Receivables Other assets Business Combination, Recognized Identifiable Assets Acquired and Liabilities Assumed, Other Noncurrent Assets Total identifiable assets Business Combination, Recognized Identifiable Assets Acquired and Liabilities Assumed, Assets Notes payable to banks Business Combination, Recognized Identifiable Assets Acquired And Liabilities Assumed, Note Payable To Banks Business Combination, Recognized Identifiable Assets Acquired And Liabilities Assumed, Note Payable To Banks Securities loaned Business Combination, Recognized Identifiable Assets Acquired And Liabilities Assumed, Securities Loaned Business Combination, Recognized Identifiable Assets Acquired And Liabilities Assumed, Securities Loaned Customer, broker-dealer and clearing payables Business Combination, Recognized Identifiable Assets Acquired And Liabilities Assumed, Broker Dealer And Clearing Organization Payables Business Combination, Recognized Identifiable Assets Acquired And Liabilities Assumed, Broker Dealer And Clearing Organization Payables Deferred income tax Business Combination, Recognized Identifiable Assets Acquired and Liabilities Assumed, Deferred Tax Liabilities Accounts payable and accrued liabilities Business Combination, Recognized Identifiable Assets Acquired And Liabilities Assumed, Accounts Payable And Accrued Liabilities Business Combination, Recognized Identifiable Assets Acquired And Liabilities Assumed, Accounts Payable And Accrued Liabilities Total identifiable liabilities Business Combination, Recognized Identifiable Assets Acquired and Liabilities Assumed, Liabilities Goodwill Goodwill Intangible assets Business Combination, Recognized Identifiable Assets Acquired and Liabilities Assumed, Intangible Assets, Other than Goodwill Total cash purchase price Payments to Acquire Businesses, Gross Notes issued Business Combination, Consideration Transferred, Liabilities Incurred Total fair value of consideration paid Business Combination, Consideration Transferred Mortgage Nonperforming Financing Receivable, Single Family [Member] Nonperforming Financing Receivable, Single Family [Member] Multifamily real estate secured Nonperforming Financing Receivable, Multifamily [Member] Nonperforming Financing Receivable, Multifamily [Member] Auto and RV secured Nonperforming Financing Receivable, Recreational Vehicle and Auto [Member] Nonperforming Financing Receivable, Recreational Vehicle and Auto [Member] Commercial & Industrial Nonperforming Financing Receivable, Commercial and Industrial [Member] Nonperforming Financing Receivable, Commercial and Industrial Other Nonperforming Financing Receivable Other Loans [Member] Nonperforming Financing Receivable Other Loans Single family real estate Other Real Estate Owned Single Family [Member] Other Real Estate Owned Single Family [Member] Autos and RVs Foreclosed Assets, Recreational Vehicle and Auto [Member] Foreclosed Assets, Recreational Vehicle and Auto [Member] Valuation Approach and Technique [Axis] Valuation Approach and Technique [Axis] Valuation Approach and Technique [Domain] Valuation Approach and Technique [Domain] Sales Comparison Approach Valuation, Market Approach [Member] Sales comparison approach, income approach, Discounted cash flows Market Approach, Income Approach, And Discounted Cash Flow Valuation Technique [Member] Market Approach, Income Approach, And Discounted Cash Flow Valuation Technique [Member] Sales comparison approach and income approach Market Approach and Income Approach Valuation Technique [Member] Market Approach and Income Approach Valuation Technique [Member] Discounted Cash Flow Valuation, Income Approach [Member] Measurement Input Type [Axis] Measurement Input Type [Axis] Measurement Input Type [Domain] Measurement Input Type [Domain] Adjustment for differences between the comparable sales Measurement Input, Comparability Adjustment [Member] Adjustment for differences between the comparable sales and adjustments for differences in net operating income expectations, capitalization rate Measurement Input, Appraised Value and Comparability Adjustment [Member] Measurement Input, Appraised Value and Comparability Adjustment Projected Constant Prepayment Rate Measurement Input, Constant Prepayment Rate [Member] Projected Constant Default Rate Measurement Input, Default Rate [Member] Projected Loss Severity Measurement Input, Loss Severity [Member] Discount Rate Measurement Input, Discount Rate [Member] Weighted Average Weighted Average [Member] Impaired loans, fair value Impaired loans, measurement input Impaired Loans, Measurement Input Impaired Loans, Measurement Input Other real estate owned, measurement input Other Real Estate Owned, Measurement Input Other repossessed assets, measurement Input Other Repossessed Assets, Measurement Input Other Repossessed Assets, Measurement Input Segment Reporting [Abstract] Number of operating segments Number of Operating Segments Schedule of Segment Reporting Information, by Segment [Table] Schedule of Segment Reporting Information, by Segment [Table] Consolidation Items [Axis] Consolidation Items [Axis] Consolidation Items [Domain] Consolidation Items [Domain] Operating segments Operating Segments [Member] Corporate/Eliminations Corporate And Reconciling Items [Member] Corporate And Reconciling Items [Member] Segments [Axis] Segments [Axis] Segments [Domain] Segments [Domain] Banking Business Banking Business [Member] Banking Business [Member] Securities Business Securities Business [Member] Securities Business [Member] Segment Reporting Information [Line Items] Segment Reporting Information [Line Items] Non-interest income Non-interest expense Goodwill Total Assets Assets Schedule of Fair Value, Off-balance Sheet Risks [Table] Schedule of Fair Value, Off-balance Sheet Risks [Table] Loan Origination Commitments Loan Origination Commitments [Member] Interest Rate Type [Axis] Interest Rate Type [Axis] Interest Rate Type [Axis] Type of Interest Rate [Domain] Type of Interest Rate [Domain] Type of Interest Rate [Domain] Fixed Interest Rate Fixed Interest Rate [Member] Fixed Interest Rate [Member] Variable Interest Rate Adjustable Interest Rate [Member] Adjustable Interest Rate [Member] Other Commitment [Axis] Other Commitment [Axis] Other Commitment [Axis] Other Commitment, Type [Domain] Other Commitment, Type [Domain] Other Commitment, Type [Domain] Sales commitment Sales Commitment [Member] Sales Commitment [Member] Fair Value, Off-balance Sheet Risks, Disclosure Information [Line Items] Fair Value, Off-balance Sheet Risks, Disclosure Information [Line Items] Off-balance sheet, loan origination commitment Fair Value Disclosure, Off-balance Sheet Risks, Face Amount, Liability Weighted average fixed interest rate on commitments to extend credit Commitment to Extend Credit, Weighted Average Interest Rate Commitment to Extend Credit, Weighted Average Interest Rate Off-balance sheet, commitment Fair Value Disclosure, Off-balance Sheet Risks, Face Amount, Asset Loss contingency, new derivative actions filed Loss Contingency, New Claims Filed, Number Loss contingency, number of pending derivative actions Loss Contingency, Pending Claims, Number Loss contingency, number of pending derivative actions to be consolidated Loss Contingency, Pending Claims Consolidated, Number Loss Contingency, Pending Claims Consolidated, Number Financial Asset, Period Past Due [Axis] Financial Asset, Period Past Due [Axis] Financial Asset, Period Past Due [Domain] Financial Asset, Period Past Due [Domain] 30-59 Days Past Due Financial Asset, 30 to 59 Days Past Due [Member] 60-89 Days Past Due Financial Asset, 60 to 89 Days Past Due [Member] 90 Plus Days Past Due Financial Asset, Equal to or Greater than 90 Days Past Due [Member] Total Financing Receivable, Past Due As a % of total gross loans and leases Financing Receivable, Recorded Investment, Past Due as a Percent of Gross Loans Financing Receivable, Recorded Investment, Past Due as a Percent of Gross Loans Stock Award Compensation Expense Unrecognized Compensation Expense [Abstract] Unrecognized Compensation Expense [Abstract] For the fiscal year remainder of 2020 Employee Service Share-based Compensation, Nonvested Awards, Total Compensation Cost Not yet Recognized, Remainder Of Fiscal Year Employee Service Share-based Compensation, Nonvested Awards, Total Compensation Cost Not yet Recognized, Remainder Of Fiscal Year 2021 Employee Service Share-based Compensation, Nonvested Awards, Total Compensation Cost Not yet Recognized, Year Two As of the balance sheet date, the aggregate unrecognized cost of equity-based awards made to employees under equity-based compensation awards that have yet to vest, expected to vest in year two after the balance sheet date. 2022 Employee Service Share-based Compensation, Nonvested Awards, Total Compensation Cost Not yet Recognized, Year Three As of the balance sheet date, the aggregate unrecognized cost of equity-based awards made to employees under equity-based compensation awards that have yet to vest, expected to vest in year three after the balance sheet date. 2023 Employee Service Share-based Compensation, Nonvested Awards, Total Compensation Cost Not yet Recognized, Year Four Employee Service Share-based Compensation, Nonvested Awards, Total Compensation Cost Not yet Recognized, Year Four 2024 Employee Service Share-based Compensation, Nonvested Awards, Total Compensation Cost Not yet Recognized, Year Five Employee Service Share-based Compensation, Nonvested Awards, Total Compensation Cost Not yet Recognized, Year Five Thereafter Employee Service Share-based Compensation, Nonvested Awards, Total Compensation Cost Not yet Recognized, After Year Five Employee Service Share-based Compensation, Nonvested Awards, Total Compensation Cost Not yet Recognized, After Year Five Total Available-for-sale, Amortized Cost: Debt Securities, Available-for-sale, Amortized Cost, Fiscal Year Maturity [Abstract] Due within one year Debt Securities, Available-for-sale, Maturity, Allocated and Single Maturity Date, within One Year, Amortized Cost Due one to five years Debt Securities, Available-for-sale, Maturity, Allocated and Single Maturity Date, after One Through Five Years, Amortized Cost Due five to ten years Debt Securities, Available-for-sale, Maturity, Allocated and Single Maturity Date, after Five Through Ten Years, Amortized Cost Due after ten years Debt Securities, Available-for-sale, Allocated and Single Maturity Date, Maturity, after 10 Years, Amortized Cost Available-for-sale, Amortized Cost Debt Securities, Available-for-sale, Maturity, without Single Maturity Date, Amortized Cost Available-for-sale, Fair Value: Debt Securities, Available-for-sale, Fair Value, Fiscal Year Maturity [Abstract] Due within one year Debt Securities, Available-for-sale, Maturity, Allocated and Single Maturity Date, within One Year, Fair Value Due one to five years Debt Securities, Available-for-sale, Maturity, Allocated and Single Maturity Date, after One Through Five Years, Fair Value Due five to ten years Debt Securities, Available-for-sale, Maturity, Allocated and Single Maturity Date, after Five Through Ten Years, Fair Value Due after ten years Debt Securities, Available-for-sale, Maturity, Allocated and Single Maturity Date, after 10 Years, Fair Value Available-for-sale, Fair Value New Accounting Pronouncements or Change in Accounting Principle [Table] New Accounting Pronouncements or Change in Accounting Principle [Table] Adjustments for New Accounting Pronouncements [Axis] Adjustments for New Accounting Pronouncements [Axis] Type of Adoption [Domain] Type of Adoption [Domain] ASU 2016-02 Accounting Standards Update 2016-02 [Member] New Accounting Pronouncements or Change in Accounting Principle [Line Items] New Accounting Pronouncements or Change in Accounting Principle [Line Items] Cash paid for amounts included in the measurement of lease liabilities for operating leases: Cash Flow, Operating Activities, Lessee [Abstract] Operating cash flows Operating Lease, Payments ROU assets obtained in the exchange for lease liabilities: Right-Of-Use Asset Obtained In Exchange For Lease Liability [Abstract] Right-Of-Use Asset Obtained In Exchange For Lease Liability [Abstract] ROU assets obtained in exchange for lease liabilities Right-of-Use Asset Obtained in Exchange for Operating Lease Liability ROU assets recognized upon adoption of new lease standard RMBS, Super Senior Securities Non-Agency RMBS, Super Senior Securities [Member] Non-Agency RMBS, Super Senior Securities [Member] Collateral [Axis] Collateral [Axis] Collateral [Domain] Collateral [Domain] Asset Pledged as Collateral Asset Pledged as Collateral [Member] Available-for-sale, number of securities Debt Securities, Available-for-sale, Number of Positions Debt Securities, Available-for-sale, Number of Positions Available-for-sale securities pledged as collateral Debt Securities, Available-for-sale, Restricted Number of available-for-sale securities in continuous loss position for a period of more than 12 months Debt Securities, Available-for-sale, Continuous Unrealized Loss Position, 12 Months or Longer, Number of Positions Number of available-for-sale securities in continuous loss position for a period of less than 12 months Debt Securities, Available-for-sale, Continuous Unrealized Loss Position, Less than 12 Months, Number of Positions Number of non-agency RMBS Debt Securities, Available-For-sale, Other-Than-Temporary Impairment Losses, Number Of Positions Debt Securities, Available-For-sale, Other-Than-Temporary Impairment Losses, Number Of Positions Carrying amount of securities with cumulative credit losses Securities with Cumulative Credit Losses, Carrying Amount Securities with Cumulative Credit Losses, Carrying Amount Cumulative credit losses Credit losses recognized in earnings Other than Temporary Impairment, Credit Losses Recognized in Earnings, Period Increase (Decrease) Number of available-for-sale securities sold Debt Securities, Available-for-sale, Number of Positions Sold Debt Securities, Available-for-sale, Number of Positions Sold Proceeds from sale of trading securities Proceeds from Sale of Debt and Equity Securities, FV-NI, Held-for-investment Realized loss on sale of trading securities Trading Securities, Realized Gain (Loss) Legal Entity [Axis] Legal Entity [Axis] Entity [Domain] Entity [Domain] WiseBanyan Holding WiseBanyan Holding [Member] WiseBanyan Holding [Member] Long-term Debt, Type [Axis] Long-term Debt, Type [Axis] Long-term Debt, Type [Domain] Long-term Debt, Type [Domain] Subordinated notes Subordinated Debt [Member] Asset Acquisition [Axis] Asset Acquisition [Axis] Asset Acquisition [Axis] Asset Acquisition [Domain] Asset Acquisition [Domain] [Domain] for Asset Acquisition [Axis] MWA Bank MWA Bank [Member] MWA Bank [Member] Nationwide Bank Nationwide Bank [Member] Nationwide Bank Number of business acquisitions Number of Businesses Acquired Number of assets acquisitions Number of Assets Acquisitions Number of Assets Acquisitions Deposit accounts Asset Acquisition, Deposits Asset Acquisition, Deposits Checking, savings and money market accounts Asset Acquisition, Deposits, Checking, Savings and Money Market Accounts Asset Acquisition, Deposits, Checking, Savings and Money Market Accounts Time deposits Asset Acquisition, Deposits, Time Deposits Asset Acquisition, Deposits, Time Deposits Number of clients Number of Clients Number of Clients Assets under management Assets under Management, Carrying Amount Cash consideration Intangible assets acquired Number of introducing broker-dealers Number of Introducing Broker-Dealers Number of Introducing Broker-Dealers Number of customers Number of Customers Number of Customers Subordinated notes Debt Instrument, Face Amount Subordinated notes maturity (in months) Long-term Debt, Term Transaction costs Business Acquisition, Transaction Costs Premium on deposit balances transferred Asset Acquisition, Premium For Deposits Purchased Asset Acquisition, Premium For Deposits Purchased Schedule of Earnings Per Share, Basic, by Common Class, Including Two Class Method [Table] Schedule of Earnings Per Share, Basic, by Common Class, Including Two Class Method [Table] Earnings Per Share, Basic, by Common Class, Including Two Class Method [Line Items] Earnings Per Share, Basic, by Common Class, Including Two Class Method [Line Items] Earnings Per Common Share Earnings Per Share, Basic [Abstract] Preferred stock dividends Dividends, Preferred Stock Net income attributable to common stockholders Average common shares outstanding (in shares) Weighted Average Number of Shares Outstanding, Basic Total qualifying shares (in shares) Total Qualifying Shares, Basic Total Qualifying Shares, Basic Diluted Earnings Per Common Share Earnings Per Share, Diluted [Abstract] Dilutive net income attributable to common stockholders Net Income (Loss) Available to Common Stockholders, Diluted Average common shares issued and outstanding (in shares) Weighted Average Number of Shares Outstanding, Diluted Dilutive effect of average unvested RSUs (in shares) Incremental Common Shares Attributable to Dilutive Effect of Share-based Payment Arrangements Total dilutive common shares outstanding (in shares) Total Dilutive Common Shares Issued and Outstanding Total Dilutive Common Shares Issued and Outstanding Fair Value Option, Disclosures [Table] Fair Value Option, Disclosures [Table] Life (in years) Measurement Input, Expected Term [Member] Projected Sales Profit of Underlying Loans Projected Profit of Underlying Loans [Member] Projected Profit of Underlying Loans Fair Value, Option, Quantitative Disclosures [Line Items] Fair Value, Option, Quantitative Disclosures [Line Items] Securities – Non-agency RMBS Available-for-sale Securities Mortgage servicing rights Derivative Instruments Derivative, Fair Value, Net Securities available-for-sale, measurement input Debt Securities, Available-for-sale, Measurement Input Mortgage servicing right, measurement input Servicing Asset, Measurement Input Derivative instruments, net, measurement input Derivative Asset, Measurement Input Cover page. Entities [Table] Entities [Table] Subordinated Notes Due 2026 Senior Subordinated Notes [Member] Entity Information [Line Items] Entity Information [Line Items] Document Type Document Type Document Quarterly Report Document Quarterly Report Document Period End Date Document Period End Date Document Transition Report Document Transition Report Entity File Number Entity File Number Entity Registrant Name Entity Registrant Name Entity Incorporation, State or Country Code Entity Incorporation, State or Country Code Entity Tax Identification Number Entity Tax Identification Number Entity Address, Address Line One Entity Address, Address Line One Entity Address, City or Town Entity Address, City or Town Entity Address, State or Province Entity Address, State or Province Entity Address, Postal Zip Code Entity Address, Postal Zip Code City Area Code City Area Code Local Phone Number Local Phone Number Title of 12(b) Security Title of 12(b) Security Trading Symbol Trading Symbol Security Exchange Name Security Exchange Name Entity Current Reporting Status Entity Current Reporting Status Entity Interactive Data Current Entity Interactive Data Current Entity Filer Category Entity Filer Category Entity Small Business Entity Small Business Entity Emerging Growth Company Entity Emerging Growth Company Entity Shell Company Entity Shell Company Entity Common Stock, Shares Outstanding Entity Common Stock, Shares Outstanding Entity Central Index Key Entity Central Index Key Current Fiscal Year End Date Current Fiscal Year End Date Document Fiscal Year Focus Document Fiscal Year Focus Document Fiscal Period Focus Document Fiscal Period Focus Amendment Flag Amendment Flag Operating Lease Expense Operating Lease, Expense Accounting Policies [Abstract] Quoted Prices in Active Markets for Identical Assets (Level 1) Significant Other Observable Inputs (Level 2) Significant Unobservable Inputs (Level 3) Cash and cash equivalents Cash and Due from Banks Cash segregated for regulatory purposes Cash and Securities Segregated under Federal and Other Regulations Total cash, cash equivalents, and cash segregated Cash, Cash Equivalents, and Federal Funds Sold Stock of regulatory agencies Federal Home Loan Bank Stock Loans held for sale, carried at fair value Loans and leases—net of allowance for loan and lease losses of $59,227 as of September 30, 2019 and $57,085 as of June 30, 2019 Loans and Leases Receivable, Net Amount Mortgage servicing rights, carried at fair value Servicing Asset Other real estate owned and repossessed vehicles Repossessed Assets Goodwill and other intangible assets—net Intangible Assets, Net (Including Goodwill) Customer, broker-dealer and clearing receivables Receivables From Trade, Brokers-Dealers And Clearing Organizations Receivables From Trade, Brokers-Dealers And Clearing Organizations Other assets Other Assets TOTAL ASSETS LIABILITIES AND STOCKHOLDERS’ EQUITY Liabilities and Equity [Abstract] Deposits: Deposits [Abstract] Non-interest bearing Noninterest-bearing Deposit Liabilities Interest bearing Interest-bearing Deposit Liabilities Total deposits Deposits Advances from the Federal Home Loan Bank Advances from Federal Home Loan Banks Borrowings, subordinated notes and debentures Subordinated Debt and Other Borrowings Subordinated Debt and Other Borrowings Customer, broker-dealer and clearing payables Payables To Trade, Brokers-Dealers And Clearing Organizations Payables To Trade, Brokers-Dealers And Clearing Organizations Accounts payable and accrued liabilities and other liabilities Accounts Payable and Other Accrued Liabilities Total liabilities Liabilities COMMITMENTS AND CONTINGENCIES (Note 10) Commitments and Contingencies Preferred stock—$0.01 par value; 1,000,000 shares authorized; Series A-$10,000 stated value and liquidation preference per share; 515 shares issued and outstanding as of September 30, 2019 and June 30, 2019 Preferred Stock, Value, Issued Common stock—$0.01 par value; 150,000,000 shares authorized; 66,837,037 shares issued and 61,287,595 shares outstanding as of September 30, 2019; 66,563,922 shares issued and 61,128,817 shares outstanding as of June 30, 2019 Common Stock, Value, Issued Additional paid-in capital Additional Paid in Capital Accumulated other comprehensive income (loss)—net of tax Accumulated Other Comprehensive Income (Loss), Net of Tax Retained earnings Retained Earnings (Accumulated Deficit) Treasury stock, at cost; 5,549,442 shares as of September 30, 2019 and 5,435,105 shares as of June 30, 2019 Treasury Stock, Value Total stockholders’ equity TOTAL LIABILITIES AND STOCKHOLDERS’ EQUITY Liabilities and Equity Consolidation Consolidation, Policy [Policy Text Block] Basis of Presentation Basis of Accounting, Policy [Policy Text Block] Business Segments Segment Reporting, Policy [Policy Text Block] Leases Lessee, Leases [Policy Text Block] Leases Lessor, Leases [Policy Text Block] New Accounting Pronouncements New Accounting Pronouncements, Policy [Policy Text Block] Fair Value Measurement Fair Value Measurement, Policy [Policy Text Block] Credit Quality Indicators Concentration Risk, Credit Risk, Policy [Policy Text Block] Earnings Per Common Share Earnings Per Share, Policy [Policy Text Block] Schedule of Non-interest Income, Segregated by Revenue Streams Disaggregation of Revenue [Table Text Block] LEASES Lessee, Operating Leases [Text Block] Schedule of Segment Reporting Information, by Segment Schedule of Segment Reporting Information, by Segment [Table Text Block] Related Party Transactions [Abstract] Number of new related party loans granted Loans and Leases Receivable, Related Parties, Number of Loans, Additions Loans and Leases Receivable, Related Parties, Number of Loans, Additions Related party loan amount granted Loans and Leases Receivable, Related Parties, Additions Number of related party loans refinanced Loans and Leases Receivable, Related Parties, Number of Loans, Refinances Loans and Leases Receivable, Related Parties, Number of Loans, Refinances Schedule of Accounts, Notes, Loans and Financing Receivable [Table] Schedule of Accounts, Notes, Loans and Financing Receivable [Table] Financing Receivable Portfolio Segment [Axis] Financing Receivable Portfolio Segment [Axis] Financing Receivable Portfolio Segment [Domain] Financing Receivable Portfolio Segment [Domain] Residential Portfolio Segment Residential Portfolio Segment [Member] Commercial Real Estate Portfolio Segment Commercial Real Estate Portfolio Segment [Member] Consumer Portfolio Segment Consumer Portfolio Segment [Member] Commercial Portfolio Segment Commercial Portfolio Segment [Member] Unallocated Financing Receivables Unallocated Financing Receivables [Member] Accounts, Notes, Loans and Financing Receivable [Line Items] Accounts, Notes, Loans and Financing Receivable [Line Items] Allowance for loan and lease losses Total net loans and leases Schedule of Business Acquisitions, by Acquisition Schedule of Business Acquisitions, by Acquisition [Table Text Block] LOANS, LEASES & ALLOWANCE FOR LOAN AND LEASE LOSSES Loans, Notes, Trade and Other Receivables Disclosure [Text Block] SEGMENT REPORTING Segment Reporting Disclosure [Text Block] RELATED PARTY TRANSACTIONS Related Party Transactions Disclosure [Text Block] U.S. agencies US Government Agencies Debt Securities [Member] Amortized Cost Debt Securities, Available-for-sale, Amortized Cost Unrealized Gains Debt Securities, Available-for-sale, Accumulated Gross Unrealized Gain, before Tax Unrealized Losses Debt Securities, Available-for-sale, Accumulated Gross Unrealized Loss, before Tax Fair Value Statement of Comprehensive Income [Abstract] Net unrealized gain (loss) from available-for-sale securities, tax expense (benefit) Other Comprehensive Income (Loss), Securities, Available-for-Sale, Unrealized Holding Gain (Loss) Arising During Period, Tax Reclassification of net (gain) loss from available-for-sale securities included in income, tax expense (benefit) Other Comprehensive Income (Loss), Reclassification Adjustment from AOCI for Sale of Securities, Tax Schedule of Components of Lease Expense Lease, Cost [Table Text Block] Schedule of Supplemental Cash Flow Information Schedule of Supplemental Balance Sheet Information Assets And Liabilities, Lessee [Table Text Block] Assets And Liabilities, Lessee [Table Text Block] Schedule of Maturities of Lease Liabilities Lessee, Operating Lease, Liability, Maturity [Table Text Block] Performing Performing Financial Instruments [Member] ACQUISITIONS Business Combination and Asset Acquisition Disclosure [Text Block] Business Combination and Asset Acquisition Disclosure [Text Block] SECURITIES Investments in Debt and Marketable Equity Securities (and Certain Trading Assets) Disclosure [Text Block] Schedule of Amortized Cost, Carrying Amount and Fair Value of Available-for-sale Securities Debt Securities, Available-for-sale [Table Text Block] Schedule of Available-for-sale Securities in Unrealized Loss Position Schedule of Unrealized Loss on Investments [Table Text Block] Schedule of Credit Losses Recognized on Available-for-sale Securities Other than Temporary Impairment, Credit Losses Recognized in Earnings [Table Text Block] Schedule of Realized Gains and Losses on Available-for-sale Securities Schedule of Realized Gain (Loss) [Table Text Block] Schedule of Unrealized Gain (Loss) on Investments on Available-for-sale Securities Unrealized Gain (Loss) on Investments [Table Text Block] Schedule of Contractual Maturities of Available-for-sale Securities Investments Classified by Contractual Maturity Date [Table Text Block] Agency Debt Agency Securities [Member] Agency RMBS Municipal Asset-backed securities and structured notes Asset-backed Securities and Structured Notes [Member] Asset-backed Securities and Structured Notes ASSETS: Securities available-for-sale Other assets—Derivative instruments Derivative Asset Other liabilities—Derivative instruments Derivative Liability Aggregate fair value Contractual balance Loans Held-for-sale, Contractual Balance, Including Accrued Interest Loans Held-for-sale, Contractual Balance, Including Accrued Interest Gain Loans Held-for-sale, Fair Value Adjustment Loans Held-for-sale, Fair Value Adjustment Interest income Loans Held-for-sale, Interest Income Loans Held-for-sale, Interest Income Change in fair value Loans Held-for-sale, Change in Fair Value Loans Held-for-sale, Change in Fair Value Total Loans Held-for-sale, Change in Fair Value, Total Loans Held-for-sale, Change in Fair Value, Total NET INCOME Net unrealized gain (loss) from available-for-sale securities, net of tax expense (benefit) of $217 and $48 for the three months ended September 30, 2019 and 2018, respectively. Other Comprehensive Income (Loss), Securities, Available-for-Sale, Unrealized Holding Gain (Loss) Arising During Period, after Tax Reclassification of net (gain) loss from available-for-sale securities included in income, net of tax expense (benefit) of $0 and $(39) for the three months ended September 30, 2019 and 2018, respectively. Other Comprehensive Income (Loss), Reclassification Adjustment from AOCI for Sale of Securities, Net of Tax Other comprehensive income (loss) Comprehensive income SUMMARY OF SIGNIFICANT ACCOUNTING POLICIES Organization, Consolidation, Basis of Presentation, Business Description and Accounting Policies [Text Block] Allowance for Loan and Lease Losses [Roll Forward] Allowance for Loan and Lease Losses [Roll Forward] Balance, beginning of period Charge-offs Allowance for Loan and Lease Losses, Write-offs Recoveries Allowance for Loan and Lease Loss, Recovery of Bad Debts Balance, end of period Restricted Stock Units Share-based Compensation Arrangement by Share-based Payment Award, Equity Instruments Other than Options, Nonvested, Number of Shares [Roll Forward] Non-vested balance, beginning (in shares) Share-based Compensation Arrangement by Share-based Payment Award, Equity Instruments Other than Options, Nonvested, Number Granted (in shares) Vested (in shares) Share-based Compensation Arrangement by Share-based Payment Award, Equity Instruments Other than Options, Vested in Period Canceled (in shares) Share-based Compensation Arrangement by Share-based Payment Award, Equity Instruments Other than Options, Forfeited in Period Non-vested balance, ending (in shares) Weighted-Average Grant-Date Fair Value Share-based Compensation Arrangement by Share-based Payment Award, Equity Instruments Other than Options, Nonvested, Weighted Average Grant Date Fair Value [Abstract] Non-vested balance, beginning, Weighted Average Grant Date Fair Value (in dollars per share) Share-based Compensation Arrangement by Share-based Payment Award, Equity Instruments Other than Options, Nonvested, Weighted Average Grant Date Fair Value Granted, Weighted Average Grant Date Fair Value (in dollars per share) Share-based Compensation Arrangement by Share-based Payment Award, Equity Instruments Other than Options, Grants in Period, Weighted Average Grant Date Fair Value Vested, Weighted Average Grant Date Fair Value (in dollars per share) Share-based Compensation Arrangement by Share-based Payment Award, Equity Instruments Other than Options, Vested in Period, Weighted Average Grant Date Fair Value Canceled, Weighted Average Grant Date Fair Value (in dollars per share) Share-based Compensation Arrangement by Share-based Payment Award, Equity Instruments Other than Options, Forfeitures, Weighted Average Grant Date Fair Value Non-vested balance, ending, Weighted Average Grant Date Fair Value (in dollars per share)