RtcEngine
The basic interface of the Agora SDK that implements the core functions of real-time communication.
RtcEngine provides the main methods that your app can call.
Before calling other APIs, you must call createAgoraRtcEngine to create an RtcEngine object.
addVideoWatermark
Adds a watermark image to the local video.
Future<void> addVideoWatermark( {required String watermarkUrl, required WatermarkOptions options});
Details
This method adds a PNG watermark image to the local video in the live streaming. Once the watermark image is added, all the audience in the channel (CDN audience included), and the capturing device can see and capture it. The Agora SDK supports adding only one watermark image onto a local video or CDN live stream. The newly added watermark image replaces the previous one.
- If the orientation mode of the encoding video (OrientationMode) is fixed landscape mode or the adaptive landscape mode, the watermark uses the landscape orientation.
- If the orientation mode of the encoding video (OrientationMode) is fixed portrait mode or the adaptive portrait mode, the watermark uses the portrait orientation.
- When setting the watermark position, the region must be less than the dimensions set in the setVideoEncoderConfiguration method; otherwise, the watermark image will be cropped.
- Ensure that calling this method after enableVideo.
- If you only want to add a watermark to the media push, you can call this method or the startRtmpStreamWithTranscoding method.
- This method supports adding a watermark image in the PNG file format only. Supported pixel formats of the PNG image are RGBA, RGB, Palette, Gray, and Alpha_gray.
- If the dimensions of the PNG image differ from your settings in this method, the image will be cropped or zoomed to conform to your settings.
- If you have enabled the mirror mode for the local video, the watermark on the local video is also mirrored. To avoid mirroring the watermark, Agora recommends that you do not use the mirror and watermark functions for the local video at the same time. You can implement the watermark function in your application layer.
Parameters
- watermarkUrl
- The local file path of the watermark image to be added. This method supports adding a watermark image from the local absolute or relative file path.
- options
- The options of the watermark image to be added. See WatermarkOptions.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
adjustAudioMixingPlayoutVolume
Adjusts the volume of audio mixing for local playback.
Future<void> adjustAudioMixingPlayoutVolume(int volume);
Call timing
You need to call this method after calling startAudioMixing and receiving the onAudioMixingStateChanged(audioMixingStatePlaying)
callback.
Restrictions
None.
Parameters
- volume
- The volume of audio mixing for local playback. The value ranges between 0 and 100 (default). 100 represents the original volume.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
adjustAudioMixingPublishVolume
Adjusts the volume of audio mixing for publishing.
Future<void> adjustAudioMixingPublishVolume(int volume);
This method adjusts the volume of audio mixing for publishing (sending to other users).
Call timing
Call this method after calling startAudioMixing and receiving the onAudioMixingStateChanged(audioMixingStatePlaying)
callback.
Restrictions
None.
Parameters
- volume
- The volume of audio mixing for local playback. The value ranges between 0 and 100 (default). 100 represents the original volume.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
adjustAudioMixingVolume
Adjusts the volume during audio mixing.
Future<void> adjustAudioMixingVolume(int volume);
This method adjusts the audio mixing volume on both the local client and remote clients.
Call timing
Call this method after startAudioMixing.
Restrictions
None.
Parameters
- volume
- Audio mixing volume. The value ranges between 0 and 100. The default value is 100, which means the original volume.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
adjustCustomAudioPlayoutVolume
Adjusts the volume of the custom audio track played locally.
Future<void> adjustCustomAudioPlayoutVolume( {required int trackId, required int volume});
Details
If you want to change the volume of the audio to be played locally, you need to call this method again.
Parameters
- trackId
- The audio track ID. Set this parameter to the custom audio track ID returned in createCustomAudioTrack.
- volume
- The volume of the audio source. The value can range from 0 to 100. 0 means mute; 100 means the original volume.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
- < 0: Failure.
adjustCustomAudioPublishVolume
Adjusts the volume of the custom audio track played remotely.
Future<void> adjustCustomAudioPublishVolume( {required int trackId, required int volume});
Details
If you want to change the volume of the audio played remotely, you need to call this method again.
Parameters
- trackId
- The audio track ID. Set this parameter to the custom audio track ID returned in createCustomAudioTrack.
- volume
- The volume of the audio source. The value can range from 0 to 100. 0 means mute; 100 means the original volume.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
- < 0: Failure.
adjustLoopbackSignalVolume
Adjusts the volume of the signal captured by the sound card.
Future<void> adjustLoopbackSignalVolume(int volume);
Details
After calling enableLoopbackRecording to enable loopback audio capturing, you can call this method to adjust the volume of the signal captured by the sound card.
Parameters
- volume
- Audio mixing volume. The value ranges between 0 and 100. The default value is 100, which means the original volume.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
- < 0: Failure.
adjustPlaybackSignalVolume
Adjusts the playback signal volume of all remote users.
Future<void> adjustPlaybackSignalVolume(int volume);
This method is used to adjust the signal volume of all remote users mixed and played locally. If you need to adjust the signal volume of a specified remote user played locally, it is recommended that you call adjustUserPlaybackSignalVolume instead.
Call timing
This method can be called either before or after joining the channel.
Restrictions
None.
Parameters
- volume
-
The volume of the user. The value range is [0,400].
- 0: Mute.
- 100: (Default) The original volume.
- 400: Four times the original volume (amplifying the audio signals by four times).
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
adjustRecordingSignalVolume
Adjusts the capturing signal volume.
Future<void> adjustRecordingSignalVolume(int volume);
If you only need to mute the audio signal, Agora recommends that you use muteRecordingSignal instead.
Call timing
This method can be called either before or after joining the channel.
Restrictions
None.
Parameters
- volume
-
The volume of the user. The value range is [0,400].
- 0: Mute.
- 100: (Default) The original volume.
- 400: Four times the original volume (amplifying the audio signals by four times).
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
adjustUserPlaybackSignalVolume
Adjusts the playback signal volume of a specified remote user.
Future<void> adjustUserPlaybackSignalVolume( {required int uid, required int volume});
You can call this method to adjust the playback volume of a specified remote user. To adjust the playback volume of different remote users, call the method as many times, once for each remote user.
Call timing
Call this method after joining a channel.
Restrictions
None.
Parameters
- uid
- The user ID of the remote user.
- volume
-
The volume of the user. The value range is [0,400].
- 0: Mute.
- 100: (Default) The original volume.
- 400: Four times the original volume (amplifying the audio signals by four times).
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
clearVideoWatermarks
Removes the watermark image from the video stream.
Future<void> clearVideoWatermarks();
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
complain
Allows a user to complain about the call quality after a call ends.
Future<void> complain({required String callId, required String description});
Details
This method allows users to complain about the quality of the call. Call this method after the user leaves the channel.
Parameters
- callId
- The current call ID. You can get the call ID by calling getCallId.
- description
- A description of the call. The string length should be less than 800 bytes.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
configRhythmPlayer
Configures the virtual metronome.
Future<void> configRhythmPlayer(AgoraRhythmPlayerConfig config);
- After calling startRhythmPlayer, you can call this method to reconfigure the virtual metronome.
- After enabling the virtual metronome, the SDK plays the specified audio effect file from the beginning, and controls the playback duration of each file according to beatsPerMinute you set in AgoraRhythmPlayerConfig. For example, if you set beatsPerMinute as
60
, the SDK plays one beat every second. If the file duration exceeds the beat duration, the SDK only plays the audio within the beat duration. - By default, the sound of the virtual metronome is published in the channel. If you want the sound to be heard by the remote users, you can set publishRhythmPlayerTrack in ChannelMediaOptions as
true
.
Call timing
This method can be called either before or after joining the channel.
Restrictions
None.
Parameters
- config
- The metronome configuration. See AgoraRhythmPlayerConfig.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
initialize
Initializes RtcEngine.
Future<void> initialize(RtcEngineContext context);
Call timing
Before calling other APIs, you must call createAgoraRtcEngine and initialize to create and initialize the RtcEngine object.
Restrictions
The SDK supports creating only one RtcEngine instance for an app.
Parameters
- context
-
Configurations for the RtcEngine instance. See RtcEngineContext.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
- < 0: Failure.
- -1: A general error occurs (no specified reason).
- -2: The parameter is invalid.
- -7: The SDK is not initialized.
- -22: The resource request failed. The SDK fails to allocate resources because your app consumes too much system resource or the system resources are insufficient.
- -101: The App ID is invalid.
createAgoraRtcEngine
Creates one RtcEngine object.
RtcEngine createAgoraRtcEngine() { return impl.RtcEngineImpl.create(); }
Details
Currently, the Agora RTC SDK v6.x supports creating only one RtcEngine object for each app.
Returns
One RtcEngine object.
createDataStream
Creates a data stream.
Future<int> createDataStream(DataStreamConfig config);
Call timing
You can call this method either before or after joining a channel.
Restrictions
Each user can create up to five data streams during the lifecycle of RtcEngine. The data stream will be destroyed when leaving the channel, and the data stream needs to be recreated if needed.
Parameters
- config
- The configurations for the data stream. See DataStreamConfig.
Exceptions
- ID of the created data stream, if the method call succeeds.
- < 0: Failure.
createMediaPlayer
Creates a media player object.
Future<MediaPlayer> createMediaPlayer();
Before calling any APIs in the MediaPlayer class, you need to call this method to create an instance of the media player. If you need to create multiple instances, you can call this method multiple times.
Call timing
You can call this method either before or after joining a channel.
Restrictions
None.
Returns
- An MediaPlayer object, if the method call succeeds.
- An empty pointer, if the method call fails.
createCustomVideoTrack
Creates a custom video track.
Future<int> createCustomVideoTrack();
Details
- Call this method to create a video track and get the video track ID.
- Call joinChannel to join the channel. In ChannelMediaOptions, set customVideoTrackId to the video track ID that you want to publish, and set publishCustomVideoTrack to
true
. - Call pushVideoFrame and specify videoTrackId as the video track ID set in step 2. You can then publish the corresponding custom video source in the channel.
Returns
- If the method call is successful, the video track ID is returned as the unique identifier of the video track.
- If the method call fails, 0xffffffff is returned.
destroyCustomVideoTrack
Destroys the specified video track.
Future<void> destroyCustomVideoTrack(int videoTrackId);
Parameters
- videoTrackId
- The video track ID returned by calling the createCustomVideoTrack method.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
destroyMediaPlayer
Destroys the media player instance.
Future<void> destroyMediaPlayer(MediaPlayer mediaPlayer);
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
- < 0: Failure.
disableAudio
Disables the audio module.
Future<void> disableAudio();
The audio module is enabled by default, and you can call this method to disable the audio module.
Call timing
This method can be called either before or after joining the channel. It is still valid after one leaves channel.
Restrictions
- enableLocalAudio: Whether to enable the microphone to create the local audio stream.
- enableLoopbackRecording: Whether to enable loopback audio capturing.
- muteLocalAudioStream: Whether to publish the local audio stream.
- muteRemoteAudioStream: Whether to subscribe and play the remote audio stream.
- muteAllRemoteAudioStreams: Whether to subscribe to and play all remote audio streams.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
disableAudioSpectrumMonitor
Disables audio spectrum monitoring.
Future<void> disableAudioSpectrumMonitor();
Details
After calling enableAudioSpectrumMonitor, if you want to disable audio spectrum monitoring, you can call this method.
You can call this method either before or after joining a channel.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
disableVideo
Disables the video module.
Future<void> disableVideo();
This method is used to disable the video module.
Call timing
- If it is called before joining the channel, the audio-only mode is enabled.
- If it is called after joining the channel, it switches from video mode to audio-only mode. Then, calling enableVideo can swithch to video mode again.
Restrictions
- This method affects the internal engine and can be called after leaving the channel.
- Calling this method will reset the entire engine, resulting in a slow response time. You can use the following methods to independently control a specific function of the video module based on your actual needs:
- enableLocalVideo: Whether to enable the camera to create the local video stream.
- muteLocalVideoStream: Whether to publish the local video stream.
- muteRemoteVideoStream: Whether to subscribe to and play the remote video stream.
- muteAllRemoteVideoStreams: Whether to subscribe to and play all remote video streams.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
enableAudio
Enables the audio module.
Future<void> enableAudio();
The audio module is enabled by default After calling disableAudio to disable the audio module, you can call this method to re-enable it.
Call timing
This method can be called either before or after joining the channel. It is still valid after one leaves channel.
Restrictions
- Calling this method will reset the entire engine, resulting in a slow response time. You can use the following methods to independently control a specific function of the audio module based on your actual needs:
- enableLocalAudio: Whether to enable the microphone to create the local audio stream.
- muteLocalAudioStream: Whether to publish the local audio stream.
- muteRemoteAudioStream: Whether to subscribe and play the remote audio stream.
- muteAllRemoteAudioStreams: Whether to subscribe to and play all remote audio streams.
- A successful call of this method resets enableLocalAudio, muteRemoteAudioStream, and muteAllRemoteAudioStreams. Proceed it with caution.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
enableAudioSpectrumMonitor
Turns on audio spectrum monitoring.
Future<void> enableAudioSpectrumMonitor({int intervalInMS = 100});
Details
If you want to obtain the audio spectrum data of local or remote users, you can register the audio spectrum observer and enable audio spectrum monitoring.
You can call this method either before or after joining a channel.
Parameters
- intervalInMS
-
The interval (in milliseconds) at which the SDK triggers the onLocalAudioSpectrum and onRemoteAudioSpectrum callbacks. The default value is 100. Do not set this parameter to a value less than 10, otherwise calling this method would fail.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
enableAudioVolumeIndication
Enables the reporting of users' volume indication.
Future<void> enableAudioVolumeIndication( {required int interval, required int smooth, required bool reportVad});
This method enables the SDK to regularly report the volume information to the app of the local user who sends a stream and remote users (three users at most) whose instantaneous volumes are the highest.
Call timing
This method can be called either before or after joining the channel.
Restrictions
None.
Parameters
- interval
- Sets the time interval between two consecutive volume indications:
- ≤ 0: Disables the volume indication.
- > 0: Time interval (ms) between two consecutive volume indications. Ensure this parameter is set to a value greater than 10, otherwise you will not receive the onAudioVolumeIndication callback. Agora recommends that this value is set as greater than 100.
- smooth
- The smoothing factor that sets the sensitivity of the audio volume indicator. The value ranges between 0 and 10. The recommended value is 3. The greater the value, the more sensitive the indicator.
- reportVad
-
true
: Enables the voice activity detection of the local user. Once it is enabled, the vad parameter of the onAudioVolumeIndication callback reports the voice activity status of the local user.false
: (Default) Disables the voice activity detection of the local user. Once it is disabled, the vad parameter of the onAudioVolumeIndication callback does not report the voice activity status of the local user, except for the scenario where the engine automatically detects the voice activity of the local user.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
enableCameraCenterStage
Enables or disables portrait center stage.
Future<void> enableCameraCenterStage(bool enabled);
The portrait center stage feature is off by default. You need to call this method to turn it on. If you need to disable this feature, you need to call this method again and set enabled to false
.
Applicable scenarios
The portrait center stage feature can be widely used in scenarios such as online meetings, shows, online education, etc. The host can use this feature to ensure that they are always in the center of the screen, whether they move or not, in order to achieve a good display effect.
Call timing
This method must be called after the camera is successfully enabled, that is, after the SDK triggers the onLocalVideoStateChanged callback and returns the local video state as localVideoStreamStateCapturing (1).
Restrictions
- iPad:
- 12.9-inch iPad Pro (5th generation)
- 11-inch iPad Pro (3rd generation)
- iPad (9th generation)
- iPad mini (6th generation)
- iPad Air (5th generation)
- 2020 M1 MacBook Pro 13-inch + iPhone 11 (using iPhone as external camera for the MacBook)
Agora recommends that you call isCameraCenterStageSupported to check whether the current device supports portrait center stage before enabling this feature.
Parameters
- enabled
- Whether to enable the portrait center stage:
true
: Enable portrait center stage.false
: Disable portrait center stage.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
enableContentInspect
Enables or disables video screenshot and upload.
Future<void> enableContentInspect( {required bool enabled, required ContentInspectConfig config});
When video screenshot and upload function is enabled, the SDK takes screenshots and uploads videos sent by local users based on the type and frequency of the module you set in ContentInspectConfig. After video screenshot and upload, the Agora server sends the callback notification to your app server in HTTPS requests and sends all screenshots to the third-party cloud storage service.
Call timing
This method can be called either before or after joining the channel.
Restrictions
- Before calling this method, ensure that you have contacted technical support to activate the video screenshot upload service.
- When the video moderation module is set to video moderation via Agora self-developed extension(contentInspectSupervision), the video screenshot and upload dynamic library
libagora_content_inspect_extension.dll
is required. Deleting this library disables the screenshot and upload feature.
Parameters
- enabled
- Whether to enalbe video screenshot and upload:
true
: Enables video screenshot and upload.false
: Disables video screenshot and upload.
- config
- Screenshot and upload configuration. See ContentInspectConfig.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
enableCustomAudioLocalPlayback
Sets whether to enable the local playback of external audio source.
Future<void> enableCustomAudioLocalPlayback( {required int trackId, required bool enabled});
Details
After calling this method to enable the local playback of external audio source, if you need to stop local playback, you can call this method again and set enabled to false
.
You can call adjustCustomAudioPlayoutVolume to adjust the local playback volume of the custom audio track.
Parameters
- trackId
- The audio track ID. Set this parameter to the custom audio track ID returned in createCustomAudioTrack.
- enabled
- Whether to play the external audio source:
true
: Play the external audio source.false
: (Default) Do not play the external source.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
enableDualStreamMode
Sets the dual-stream mode on the sender side and the low-quality video stream.
Future<void> enableDualStreamMode( {required bool enabled, SimulcastStreamConfig? streamConfig});
Details
- Deprecated:
- This method is deprecated as of v4.2.0. Use setDualStreamMode instead.
- High-quality video stream: High bitrate, high resolution.
- Low-quality video stream: Low bitrate, low resolution.
After you enable dual-stream mode, you can call setRemoteVideoStreamType to choose to receive either the high-quality video stream or the low-quality video stream on the subscriber side.
- This method is applicable to all types of streams from the sender, including but not limited to video streams collected from cameras, screen sharing streams, and custom-collected video streams.
- If you need to enable dual video streams in a multi-channel scenario, you can call the enableDualStreamModeEx method.
- You can call this method either before or after joining a channel.
Parameters
- enabled
-
Whether to enable dual-stream mode:
true
: Enable dual-stream mode.false
: (Default) Disable dual-stream mode.
- streamConfig
-
The configuration of the low-quality video stream. See SimulcastStreamConfig.Note: When setting mode to disableSimulcastStream, setting streamConfig will not take effect.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
enableEncryption
Enables or disables the built-in encryption.
Future<void> enableEncryption( {required bool enabled, required EncryptionConfig config});
After the user leaves the channel, the SDK automatically disables the built-in encryption. To enable the built-in encryption, call this method before the user joins the channel again.
Applicable scenarios
Scenarios with higher security requirements.
Call timing
Call this method before joining a channel.
Restrictions
- All users within the same channel must set the same encryption configurations when calling this method.
- If you enable the built-in encryption, you cannot use the Media Push function.
Parameters
- enabled
-
Whether to enable built-in encryption:
- true: Enable the built-in encryption.
- false: (Default) Disable the built-in encryption.
- config
- Built-in encryption configurations. See EncryptionConfig.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
enableExtension
Enables or disables extensions.
Future<void> enableExtension( {required String provider, required String extension, bool enable = true, MediaSourceType type = MediaSourceType.unknownMediaSource});
Call timing
Agora recommends that you call this method after joining a channel.
Restrictions
- If you want to enable multiple extensions, you need to call this method multiple times.
- After a successful call of this method, you cannot load other extensions.
Parameters
- provider
- The name of the extension provider.
- extension
- The name of the extension.
- enable
-
Whether to enable the extension:
true
: Enable the extension.false
: Disable the extension.
- type
- Source type of the extension. See MediaSourceType.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
enableFaceDetection
Enables or disables face detection for the local user.
Future<void> enableFaceDetection(bool enabled);
Call timing
This method needs to be called after the camera is started (for example, by calling startPreview or enableVideo).
Restrictions
None.
Parameters
- enabled
- Whether to enable face detection for the local user:
true
: Enable face detection.false
: (Default) Disable face detection.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
enableInEarMonitoring
Enables in-ear monitoring.
Future<void> enableInEarMonitoring( {required bool enabled, required EarMonitoringFilterType includeAudioFilters});
This method enables or disables in-ear monitoring.
Call timing
This method can be called either before or after joining the channel.
Restrictions
Users must use earphones (wired or Bluetooth) to hear the in-ear monitoring effect.
Parameters
- enabled
- Enables or disables in-ear monitoring.
true
: Enables in-ear monitoring.false
: (Default) Disables in-ear monitoring.
- includeAudioFilters
- The audio filter types of in-ear monitoring. See EarMonitoringFilterType.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
enableInstantMediaRendering
Enables audio and video frame instant rendering.
Future<void> enableInstantMediaRendering();
After successfully calling this method, the SDK enables the instant frame rendering mode, which can speed up the first frame rendering after the user joins the channel.
Applicable scenarios
Agora recommends that you enable this mode for the audience in a live streaming scenario.
Call timing
Call this method before joining a channel.
Restrictions
Once the method is successfully called, you can only cancel instant rendering by calling release to destroy the RtcEngine object.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
enableLocalAudio
Enables or disables the local audio capture.
Future<void> enableLocalAudio(bool enabled);
The audio function is enabled by default when users joining a channel. This method disables or re-enables the local audio function to stop or restart local audio capturing.
- enableLocalAudio: Disables or re-enables the local audio capturing and processing. If you disable or re-enable local audio capturing using the enableLocalAudio method, the local user might hear a pause in the remote audio playback.
- muteLocalAudioStream: Sends or stops sending the local audio streams without affecting the audio capture status.
Applicable scenarios
This method does not affect receiving the remote audio streams. enableLocalAudio(false)
is suitable for scenarios where the user wants to receive remote audio streams without sending locally captured audio.
Call timing
You can call this method either before or after joining a channel. Calling it before joining a channel only sets the device state, and it takes effect immediately after you join the channel.
Restrictions
None.
Parameters
- enabled
-
true
: (Default) Re-enable the local audio function, that is, to start the local audio capturing device (for example, the microphone).false
: Disable the local audio function, that is, to stop local audio capturing.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
enableLocalVideo
Enables/Disables the local video capture.
Future<void> enableLocalVideo(bool enabled);
Details
This method disables or re-enables the local video capture, and does not affect receiving the remote video stream.
After calling enableVideo, the local video capture is enabled by default.
If you call enableLocalVideo(false
) to disable local video capture within the channel, it also simultaneously stops publishing the video stream within the channel. If you want to restart video catpure, you can call enableLocalVideo(true
) and then call updateChannelMediaOptions to set the options parameter to publish the locally captured video stream in the channel.
After the local video capturer is successfully disabled or re-enabled, the SDK triggers the onRemoteVideoStateChanged callback on the remote client.
- You can call this method either before or after joining a channel.
- This method enables the internal engine and is valid after leaving the channel.
Parameters
- enabled
-
Whether to enable the local video capture.
true
: (Default) Enable the local video capture.false
: Disable the local video capture. Once the local video is disabled, the remote users cannot receive the video stream of the local user, while the local user can still receive the video streams of remote users. When set tofalse
, this method does not require a local camera.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
enableLoopbackRecording
Enables loopback audio capturing.
Future<void> enableLoopbackRecording( {required bool enabled, String? deviceName});
Details
If you enable loopback audio capturing, the output of the sound card is mixed into the audio stream sent to the other end.
- This method applies to the macOS and Windows only.
- You can call this method either before or after joining a channel.
- If you call the disableAudio method to disable the audio module, audio capturing will be disabled as well. If you need to enable audio capturing, call the enableAudio method to enable the audio module and then call the enableLoopbackRecording method.
Parameters
- enabled
- Sets whether to enable loopback audio capturing.
true
: Enable sound card capturing. You can find the name of the virtual sound card in your system'sAudio Devices > Output.false
: Disable sound card capturing. The name of the virtual sound card will not be shown in your system's Audio Devices > Output.
- deviceName
-
- macOS: The device name of the virtual sound card. The default value is set to NULL, which means using AgoraALD for loopback audio capturing.
- Windows: The device name of the sound card. The default is set to NULL, which means the SDK uses the sound card of your device for loopback audio capturing.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
enableMultiCamera
Enables or disables multi-camera capture.
Future<void> enableMultiCamera( {required bool enabled, required CameraCapturerConfiguration config});
Details
- Call this method to enable multi-channel camera capture.
- Call startPreview to start the local video preview.
- Call startCameraCapture, and set sourceType to start video capture with the second camera.
- Call joinChannelEx, and set publishSecondaryCameraTrack to
true
to publish the video stream captured by the second camera in the channel.
- Call stopCameraCapture.
- Call this method with enabled set to
false
.
- If it is enabled before startPreview, the local video preview shows the image captured by the two cameras at the same time.
- If it is enabled after startPreview, the SDK stops the current camera capture first, and then enables the primary camera and the second camera. The local video preview appears black for a short time, and then automatically returns to normal.
This method applies to iOS only.
When using this function, ensure that the system version is 13.0 or later.
- iPhone XR
- iPhone XS
- iPhone XS Max
- iPad Pro 3rd generation and later
Parameters
- enabled
- Whether to enable multi-camera video capture mode:
true
: Enable multi-camera capture mode; the SDK uses multiple cameras to capture video.false
: Disable multi-camera capture mode; the SDK uses a single camera to capture video.
- config
- Capture configuration for the second camera. See CameraCapturerConfiguration.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
enableSpatialAudio
Enables or disables the spatial audio effect.
Future<void> enableSpatialAudio(bool enabled);
Details
After enabling the spatial audio effect, you can call setRemoteUserSpatialAudioParams to set the spatial audio effect parameters of the remote user.
- You can call this method either before or after joining a channel.
- This method relies on the spatial audio dynamic library
libagora_spatial_audio_extension.dll
. If the dynamic library is deleted, the function cannot be enabled normally.
Parameters
- enabled
- Whether to enable the spatial audio effect:
true
: Enable the spatial audio effect.false
: Disable the spatial audio effect.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
enableSoundPositionIndication
Enables or disables stereo panning for remote users.
Future<void> enableSoundPositionIndication(bool enabled);
Details
Ensure that you call this method before joining a channel to enable stereo panning for remote users so that the local user can track the position of a remote user by calling setRemoteVoicePosition.
Parameters
- enabled
- Whether to enable stereo panning for remote users:
true
: Enable stereo panning.false
: Disable stereo panning.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
enableVideo
Enables the video module.
Future<void> enableVideo();
The video module is disabled by default, call this method to enable it. If you need to disable the video module later, you need to call disableVideo.
Call timing
- If called before joining a channel, it enables the video module.
- If called during an audio-only call, the audio call automatically switches to a video call.
Restrictions
- This method enables the internal engine and is valid after leaving the channel.
- Calling this method will reset the entire engine, resulting in a slow response time. You can use the following methods to independently control a specific function of the video module based on your actual needs:
- enableLocalVideo: Whether to enable the camera to create the local video stream.
- muteLocalVideoStream: Whether to publish the local video stream.
- muteRemoteVideoStream: Whether to subscribe to and play the remote video stream.
- muteAllRemoteVideoStreams: Whether to subscribe to and play all remote video streams.
- A successful call of this method resets enableLocalVideo, muteRemoteVideoStream, and muteAllRemoteVideoStreams. Proceed it with caution.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
enableVideoImageSource
Sets whether to replace the current video feeds with images when publishing video streams.
Future<void> enableVideoImageSource( {required bool enable, required ImageTrackOptions options});
When publishing video streams, you can call this method to replace the current video feeds with custom images.
Once you enable this function, you can select images to replace the video feeds through the ImageTrackOptions parameter. If you disable this function, the remote users see the video feeds that you publish.
Call timing
Call this method after joining a channel.
Restrictions
None.
Parameters
- enable
- Whether to replace the current video feeds with custom images:
true
: Replace the current video feeds with custom images.false
: (Default) Do not replace the current video feeds with custom images.
- options
- Image configurations. See ImageTrackOptions.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
- < 0: Failure.
enableVirtualBackground
Enables/Disables the virtual background.
Future<void> enableVirtualBackground( {required bool enabled, required VirtualBackgroundSource backgroundSource, required SegmentationProperty segproperty, MediaSourceType type = MediaSourceType.primaryCameraSource});
Details
The virtual background feature enables the local user to replace their original background with a static image, dynamic video, blurred background, or portrait-background segmentation to achieve picture-in-picture effect. Once the virtual background feature is enabled, all users in the channel can see the custom background.
Call this method after calling enableVideo or startPreview.
- This feature has high requirements on device performance. When calling this method, the SDK automatically checks the capabilities of the current device. Agora recommends you use virtual background on devices with the following processors:
- Snapdragon 700 series 750G and later
- Snapdragon 800 series 835 and later
- Dimensity 700 series 720 and later
- Kirin 800 series 810 and later
- Kirin 900 series 980 and later
- Devices with an A9 chip and better, as follows:
- iPhone 6S and later
- iPad Air 3rd generation and later
- iPad 5th generation and later
- iPad Pro 1st generation and later
- iPad mini 5th generation and later
- Agora recommends that you use this feature in scenarios that meet the following conditions:
- A high-definition camera device is used, and the environment is uniformly lit.
- There are few objects in the captured video. Portraits are half-length and unobstructed. Ensure that the background is a solid color that is different from the color of the user's clothing.
- This method relies on the virtual background dynamic library
libagora_segmentation_extension.dll
. If the dynamic library is deleted, the function cannot be enabled normally.
Parameters
- enabled
- Whether to enable virtual background:
true
: Enable virtual background.false
: Disable virtual background.
- backgroundSource
- The custom background. See VirtualBackgroundSource. To adapt the resolution of the custom background image to that of the video captured by the SDK, the SDK scales and crops the custom background image while ensuring that the content of the custom background image is not distorted.
- segproperty
- Processing properties for background images. See SegmentationProperty.
- type
- The type of the media source to which the filter effect is applied. See MediaSourceType.Attention: In this method, this parameter supports only the following two settings:
- Use the default value primaryCameraSource if you use camera to capture local video.
- Set this parameter to customVideoSource if you use custom video source.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
enableVoiceAITuner
Enables or disables the voice AI tuner.
Future<void> enableVoiceAITuner( {required bool enabled, required VoiceAiTunerType type});
The voice AI tuner supports enhancing sound quality and adjusting tone style.
Applicable scenarios
Social entertainment scenes including online KTV, online podcast and live streaming in showrooms, where high sound quality is required.
Call timing
This method can be called either before or after joining the channel.
Restrictions
None.
Parameters
- enabled
- Whether to enable the voice AI tuner:
true
: Enables the voice AI tuner.false
: (Default) Disable the voice AI tuner.
- type
- Voice AI tuner sound types, see VoiceAiTunerType.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
enableWebSdkInteroperability
Enables interoperability with the Agora Web SDK (applicable only in the live streaming scenarios).
Future<void> enableWebSdkInteroperability(bool enabled);
Details
- Deprecated:
- The SDK automatically enables interoperability with the Web SDK, so you no longer need to call this method.
You can call this method to enable or disable interoperability with the Agora Web SDK. If a channel has Web SDK users, ensure that you call this method, or the video of the Native user will be a black screen for the Web user.
This method is only applicable in live streaming scenarios, and interoperability is enabled by default in communication scenarios.
Parameters
- enabled
- Whether to enable interoperability:
true
: Enable interoperability.false
: (Default) Disable interoperability.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
getAudioDeviceInfo
Gets the audio device information.
Future<DeviceInfo> getAudioDeviceInfo();
Details
After calling this method, you can get whether the audio device supports ultra-low-latency capture and playback.
- This method is for Android only.
- You can call this method either before or after joining a channel.
Returns
- Not null: Success.
- Null: Failure.
getAudioDeviceManager
Gets the AudioDeviceManager object to manage audio devices.
AudioDeviceManager getAudioDeviceManager();
Returns
One AudioDeviceManager object.
getAudioMixingCurrentPosition
Retrieves the playback position (ms) of the music file.
Future<int> getAudioMixingCurrentPosition();
Details
Retrieves the playback position (ms) of the audio.
- You need to call this method after calling startAudioMixing and receiving the onAudioMixingStateChanged
(audioMixingStatePlaying)
callback. - If you need to call getAudioMixingCurrentPosition multiple times, ensure that the time interval between calling this method is more than 500 ms.
Returns
- ≥ 0: The current playback position (ms) of the audio mixing, if this method call succeeds. 0 represents that the current music file does not start playing.
- < 0: Failure.
getAudioMixingDuration
Retrieves the duration (ms) of the music file.
Future<int> getAudioMixingDuration();
Retrieves the total duration (ms) of the audio.
Call timing
Call this method after startAudioMixing and receiving the onAudioMixingStateChanged(audioMixingStatePlaying)
callback.
Restrictions
None.
Returns
- ≥ 0: The audio mixing duration, if this method call succeeds.
- < 0: Failure.
getAudioMixingPlayoutVolume
Retrieves the audio mixing volume for local playback.
Future<int> getAudioMixingPlayoutVolume();
You can call this method to get the local playback volume of the mixed audio file, which helps in troubleshooting volume‑related issues.
Call timing
Call this method after startAudioMixing and receiving the onAudioMixingStateChanged(audioMixingStatePlaying)
callback.
Restrictions
None.
Returns
- ≥ 0: The audio mixing volume, if this method call succeeds. The value range is [0,100].
- < 0: Failure.
getAudioMixingPublishVolume
Retrieves the audio mixing volume for publishing.
Future<int> getAudioMixingPublishVolume();
Details
This method helps troubleshoot audio volume‑related issues.
(audioMixingStatePlaying)
callback.Returns
- ≥ 0: The audio mixing volume, if this method call succeeds. The value range is [0,100].
- < 0: Failure.
getAudioTrackCount
Gets the index of audio tracks of the current music file.
Future<int> getAudioTrackCount();
Details
- You need to call this method after calling startAudioMixing and receiving the onAudioMixingStateChanged
(audioMixingStatePlaying)
callback.
Returns
- The SDK returns the index of the audio tracks if the method call succeeds.
- < 0: Failure.
getCallId
Retrieves the call ID.
Future<String> getCallId();
When a user joins a channel on a client, a callId is generated to identify the call from the client. You can call this method to get callId, and pass it in when calling methods such as rate and complain.
Call timing
Call this method after joining a channel.
Restrictions
None.
Parameters
- callId
- Output parameter, the current call ID.
Returns
The current call ID.
getCameraMaxZoomFactor
Gets the maximum zoom ratio supported by the camera.
Future<double> getCameraMaxZoomFactor();
Details
- This method is for Android and iOS only.
- This method must be called after the SDK triggers the onLocalVideoStateChanged callback and returns the local video state as localVideoStreamStateCapturing (1).
Returns
The maximum zoom factor.
getConnectionState
Gets the current connection state of the SDK.
Future<ConnectionStateType> getConnectionState();
Call timing
This method can be called either before or after joining the channel.
Restrictions
None.
Exceptions
The current connection state. See ConnectionStateType.
getCurrentMonotonicTimeInMs
Gets the current Monotonic Time of the SDK.
Future<int> getCurrentMonotonicTimeInMs();
Monotonic Time refers to a monotonically increasing time series whose value increases over time. The unit is milliseconds.
In custom video capture and custom audio capture scenarios, in order to ensure audio and video synchronization, Agora recommends that you call this method to obtain the current Monotonic Time of the SDK, and then pass this value into the timestamp parameter in the captured video frame (VideoFrame) and audio frame (AudioFrame).
Call timing
This method can be called either before or after joining the channel.
Restrictions
None.
Returns
- ≥0: The method call is successful, and returns the current Monotonic Time of the SDK (in milliseconds).
- < 0: Failure.
getEffectCurrentPosition
Retrieves the playback position of the audio effect file.
Future<int> getEffectCurrentPosition(int soundId);
Details
Parameters
- soundId
- The audio effect ID. The ID of each audio effect file is unique.
Returns
- The playback position (ms) of the specified audio effect file, if the method call succeeds.
- < 0: Failure.
getEffectDuration
Retrieves the duration of the audio effect file.
Future<int> getEffectDuration(String filePath);
Details
Parameters
- filePath
- File path:
- Android: The file path, which needs to be accurate to the file name and suffix. Agora supports URL addresses, absolute paths, or file paths that start with
/assets/
. You might encounter permission issues if you use an absolute path to access a local file, so Agora recommends using a URI address instead. For example: content://com.android.providers.media.documents/document/audio%3A14441
- Windows: The absolute path or URL address (including the suffixes of the filename) of the audio effect file. For example
: C:\music\audio.mp4
. - iOS or macOS: The absolute path or URL address (including the suffixes of the filename) of the audio effect file. For example:
/var/mobile/Containers/Data/audio.mp4
.
- Android: The file path, which needs to be accurate to the file name and suffix. Agora supports URL addresses, absolute paths, or file paths that start with
Returns
- The total duration (ms) of the specified audio effect file, if the method call succeeds.
- < 0: Failure.
getEffectsVolume
Retrieves the volume of the audio effects.
Future<int> getEffectsVolume();
Details
The volume is an integer ranging from 0 to 100. The default value is 100, which means the original volume.
Returns
- Volume of the audio effects, if this method call succeeds.
- < 0: Failure.
getErrorDescription
Gets the warning or error description.
Future<String> getErrorDescription(int code);
Parameters
- code
- The error code reported by the SDK.
Returns
The specific error description.
getExtensionProperty
Gets detailed information on the extensions.
Future<String> getExtensionProperty( {required String provider, required String extension, required String key, required int bufLen, MediaSourceType type = MediaSourceType.unknownMediaSource});
Call timing
This method can be called either before or after joining the channel.
Restrictions
None.
Parameters
- provider
- The name of the extension provider.
- extension
- The name of the extension.
- key
- The key of the extension.
- type
- Source type of the extension. See MediaSourceType.
- bufLen
- Maximum length of the JSON string indicating the extension property. The maximum value is 512 bytes.
Returns
- The extension information, if the method call succeeds.
- An empty string, if the method call fails.
getLocalSpatialAudioEngine
Gets one LocalSpatialAudioEngine object.
LocalSpatialAudioEngine getLocalSpatialAudioEngine();
Details
Returns
One LocalSpatialAudioEngine object.
getMediaEngine
Gets one MediaEngine object.
MediaEngine getMediaEngine();
Details
Returns
One MediaEngine object.
getNativeHandle
Gets the C++ handle of the Native SDK.
Future<int> getNativeHandle();
Details
This method retrieves the C++ handle of the SDK, which is used for registering the audio and video frame observer.
Returns
The native handle of the SDK.
getNetworkType
Gets the type of the local network connection.
Future<int> getNetworkType();
Details
You can use this method to get the type of network in use at any stage.
Returns
- ≥ 0: The method call is successful, and the local network connection type is returned.
- 0: The SDK disconnects from the network.
- 1: The network type is LAN.
- 2: The network type is Wi-Fi (including hotspots).
- 3: The network type is mobile 2G.
- 4: The network type is mobile 3G.
- 5: The network type is mobile 4G.
- 6: The network type is mobile 5G.
- < 0: The method call failed with an error code.
- -1: The network type is unknown.
getNtpWallTimeInMs
Gets the current NTP (Network Time Protocol) time.
Future<int> getNtpWallTimeInMs();
Details
In the real-time chorus scenario, especially when the downlink connections are inconsistent due to network issues among multiple receiving ends, you can call this method to obtain the current NTP time as the reference time, in order to align the lyrics and music of multiple receiving ends and achieve chorus synchronization.
Returns
The Unix timestamp (ms) of the current NTP time.
getScreenCaptureSources
Gets a list of shareable screens and windows.
Future<List<ScreenCaptureSourceInfo>> getScreenCaptureSources( {required Size thumbSize, required Size iconSize, required bool includeScreen});
Details
You can call this method before sharing a screen or window to get a list of shareable screens and windows, which enables a user to use thumbnails in the list to easily choose a particular screen or window to share. This list also contains important information such as window ID and screen ID, with which you can call startScreenCaptureByWindowId or startScreenCaptureByDisplayId to start the sharing.
Parameters
- thumbSize
- The target size of the screen or window thumbnail (the width and height are in pixels). The SDK scales the original image to make the length of the longest side of the image the same as that of the target size without distorting the original image. For example, if the original image is 400 Ă— 300 and thumbSize is 100 Ă— 100, the actual size of the thumbnail is 100 Ă— 75. If the target size is larger than the original size, the thumbnail is the original image and the SDK does not scale it.
- iconSize
- The target size of the icon corresponding to the application program (the width and height are in pixels). The SDK scales the original image to make the length of the longest side of the image the same as that of the target size without distorting the original image. For example, if the original image is 400 Ă— 300 and iconSize is 100 Ă— 100, the actual size of the icon is 100 Ă— 75. If the target size is larger than the original size, the icon is the original image and the SDK does not scale it.
- includeScreen
- Whether the SDK returns the screen information in addition to the window information:
true
: The SDK returns screen and window information.false
: The SDK returns window information only.
Returns
The ScreenCaptureSourceInfo array.
getUserInfoByUid
Gets the user information by passing in the user ID.
Future<UserInfo> getUserInfoByUid(int uid);
After a remote user joins the channel, the SDK gets the UID and user account of the remote user, caches them in a mapping table object, and triggers the onUserInfoUpdated callback on the local client. After receiving the callback, you can call this method and passi in the UID.to get the user account of the specified user from the UserInfo object.
Call timing
Call this method after receiving the onUserInfoUpdated callback.
Restrictions
None.
Parameters
- uid
- The user ID.
Returns
- A pointer to the UserInfo instance, if the method call succeeds.
- If the call fails, returns NULL.
getUserInfoByUserAccount
Gets the user information by passing in the user account.
Future<UserInfo> getUserInfoByUserAccount(String userAccount);
After a remote user joins the channel, the SDK gets the UID and user account of the remote user, caches them in a mapping table object, and triggers the onUserInfoUpdated callback on the local client. After receiving the callback, you can call this method and pass in the user account to get the UID of the remote user from the UserInfo object.
Call timing
Call this method after receiving the onUserInfoUpdated callback.
Restrictions
None.
Parameters
- userAccount
- The user account.
Returns
- A pointer to the UserInfo instance, if the method call succeeds.
- If the call fails, returns NULL.
getVersion
Gets the SDK version.
Future<SDKBuildInfo> getVersion();
Parameters
Returns
One SDKBuildInfo object.
getVideoDeviceManager
Gets the VideoDeviceManager object to manage video devices.
VideoDeviceManager getVideoDeviceManager();
Returns
One VideoDeviceManager object.
getVolumeOfEffect
Gets the volume of a specified audio effect file.
Future<int> getVolumeOfEffect(int soundId);
Parameters
- soundId
- The ID of the audio effect file.
Returns
- ≥ 0: Returns the volume of the specified audio effect, if the method call is successful. The value ranges between 0 and 100. 100 represents the original volume.
- < 0: Failure.
isCameraAutoExposureFaceModeSupported
Checks whether the device supports auto exposure.
Future<bool> isCameraAutoExposureFaceModeSupported();
Details
- This method applies to iOS only.
- This method must be called after the SDK triggers the onLocalVideoStateChanged callback and returns the local video state as localVideoStreamStateCapturing (1).
Returns
true
: The device supports auto exposure.false
: The device does not support auto exposure.
isCameraAutoFocusFaceModeSupported
Checks whether the device supports the face auto-focus function.
Future<bool> isCameraAutoFocusFaceModeSupported();
Details
- This method is for Android and iOS only.
- This method must be called after the SDK triggers the onLocalVideoStateChanged callback and returns the local video state as localVideoStreamStateCapturing (1).
Returns
true
: The device supports the face auto-focus function.false
: The device does not support the face auto-focus function.
isCameraCenterStageSupported
Check if the camera supports portrait center stage.
Future<bool> isCameraCenterStageSupported();
Before calling enableCameraCenterStage to enable portrait center stage, it is recommended to call this method to check if the current device supports the feature.
Call timing
This method must be called after the camera is successfully enabled, that is, after the SDK triggers the onLocalVideoStateChanged callback and returns the local video state as localVideoStreamStateCapturing (1).
Restrictions
None.
Exceptions
true
: The current camera supports the portrait center stage.false
: The current camera supports the portrait center stage.
isCameraExposurePositionSupported
Checks whether the device supports manual exposure.
Future<bool> isCameraExposurePositionSupported();
Details
- This method is for Android and iOS only.
- This method must be called after the SDK triggers the onLocalVideoStateChanged callback and returns the local video state as localVideoStreamStateCapturing (1).
Returns
true
: The device supports manual exposure.false
: The device does not support manual exposure.
isCameraExposureSupported
Queries whether the current camera supports adjusting exposure value.
Future<bool> isCameraExposureSupported();
Details
- This method is for Android and iOS only.
- This method must be called after the SDK triggers the onLocalVideoStateChanged callback and returns the local video state as localVideoStreamStateCapturing (1).
- Before calling setCameraExposureFactor, Agora recoomends that you call this method to query whether the current camera supports adjusting the exposure value.
- By calling this method, you adjust the exposure value of the currently active camera, that is, the camera specified when calling setCameraCapturerConfiguration.
Returns
true
: Success.false
: Failure.
isCameraFaceDetectSupported
Checks whether the device camera supports face detection.
Future<bool> isCameraFaceDetectSupported();
- This method is for Android and iOS only.
- This method must be called after the SDK triggers the onLocalVideoStateChanged callback and returns the local video state as localVideoStreamStateCapturing (1).
Returns
true
: The device camera supports face detection.false
: The device camera does not support face detection.
isCameraFocusSupported
Check whether the device supports the manual focus function.
Future<bool> isCameraFocusSupported();
Details
- This method is for Android and iOS only.
- This method must be called after the SDK triggers the onLocalVideoStateChanged callback and returns the local video state as localVideoStreamStateCapturing (1).
Returns
true
: The device supports the manual focus function.false
: The device does not support the manual focus function.
isCameraTorchSupported
Checks whether the device supports camera flash.
Future<bool> isCameraTorchSupported();
Details
- This method is for Android and iOS only.
- This method must be called after the SDK triggers the onLocalVideoStateChanged callback and returns the local video state as localVideoStreamStateCapturing (1).
- The app enables the front camera by default. If your front camera does not support flash, this method returns false. If you want to check whether the rear camera supports the flash function, call switchCamera before this method.
- On iPads with system version 15, even if isCameraTorchSupported returns
true
, you might fail to successfully enable the flash by calling setCameraTorchOn due to system issues.
Returns
true
: The device supports camera flash.false
: The device does not support camera flash.
isCameraZoomSupported
Checks whether the device supports camera zoom.
Future<bool> isCameraZoomSupported();
Call timing
This method must be called after the SDK triggers the onLocalVideoStateChanged callback and returns the local video state as localVideoStreamStateCapturing (1).
Restrictions
None.
Returns
true
: The device supports camera zoom.false
: The device does not support camera zoom.
isFeatureAvailableOnDevice
Checks whether the device supports the specified advanced feature.
Future<bool> isFeatureAvailableOnDevice(FeatureType type);
Details
Checks whether the capabilities of the current device meet the requirements for advanced features such as virtual background and image enhancement.
Applicable scenarios
Before using advanced features, you can check whether the current device supports these features based on the call result. This helps to avoid performance degradation or unavailable features when enabling advanced features on low-end devices. Based on the return value of this method, you can decide whether to display or enable the corresponding feature button, or notify the user when the device's capabilities are insufficient.
Parameters
- type
- The type of the advanced feature, see FeatureType.
Returns
true
: The current device supports the specified feature.false
: The current device does not support the specified feature.
isSpeakerphoneEnabled
Checks whether the speakerphone is enabled.
Future<bool> isSpeakerphoneEnabled();
Call timing
You can call this method either before or after joining a channel.
Restrictions
None.
Returns
true
: The speakerphone is enabled, and the audio plays from the speakerphone.false
: The speakerphone is not enabled, and the audio plays from devices other than the speakerphone. For example, the headset or earpiece.
joinChannel
Joins a channel with media options.
Future<void> joinChannel( {required String token, required String channelId, required int uid, required ChannelMediaOptions options});
This method supports setting the media options when joining a channel, such as whether to publish audio and video streams within the channel. or whether to automatically subscribe to the audio and video streams of all remote users when joining a channel. By default, the user subscribes to the audio and video streams of all the other users in the channel, giving rise to usage and billings. To stop subscribing to other streams, set the options parameter or call the corresponding mute methods.
Call timing
Call this method after initialize.
Restrictions
- This method only supports users joining one channel at a time.
- Users with different App IDs cannot call each other.
- Before joining a channel, ensure that the App ID you use to generate a token is the same as that you pass in the initialize method; otherwise, you may fail to join the channel with the token.
Parameters
- token
- The token generated on your server for authentication. See .Note:
- (Recommended) If your project has enabled the security mode (using APP ID and Token for authentication), this parameter is required.
- If you have only enabled the testing mode (using APP ID for authentication), this parameter is optional. You will automatically exit the channel 24 hours after successfully joining in.
- If you need to join different channels at the same time or switch between channels, Agora recommends using a wildcard token so that you don't need to apply for a new token every time joining a channel. See Secure authentication with tokens.
- channelId
-
The channel name. This parameter signifies the channel in which users engage in real-time audio and video interaction. Under the premise of the same App ID, users who fill in the same channel ID enter the same channel for audio and video interaction. The string length must be less than 64 bytes. Supported characters (89 characters in total):
- All lowercase English letters: a to z.
- All uppercase English letters: A to Z.
- All numeric characters: 0 to 9.
- "!", "#", "$", "%", "&", "(", ")", "+", "-", ":", ";", "<", "=", ".", ">", "?", "@", "[", "]", "^", "_", "{", "}", "|", "~", ","
- uid
- The user ID. This parameter is used to identify the user in the channel for real-time audio and video interaction. You need to set and manage user IDs yourself, and ensure that each user ID in the same channel is unique. This parameter is a 32-bit unsigned integer. The value range is 1 to 232-1. If the user ID is not assigned (or set to 0), the SDK assigns a random user ID and onJoinChannelSuccess returns it in the callback. Your application must record and maintain the returned user ID, because the SDK does not do so.
- options
- The channel media options. See ChannelMediaOptions.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
- < 0: Failure.
- -2: The parameter is invalid. For example, the token is invalid, the uid parameter is not set to an integer, or the value of a member in ChannelMediaOptions is invalid. You need to pass in a valid parameter and join the channel again.
- -3: Fails to initialize the RtcEngine object. You need to reinitialize the RtcEngine object.
- -7: The RtcEngine object has not been initialized. You need to initialize the RtcEngine object before calling this method.
- -8: The internal state of the RtcEngine object is wrong. The typical cause is that after calling startEchoTest to start a call loop test, you call this method to join the channel without calling stopEchoTest to stop the test. You need to call stopEchoTest before calling this method.
- -17: The request to join the channel is rejected. The typical cause is that the user is already in the channel. Agora recommends that you use the onConnectionStateChanged callback to see whether the user is in the channel. Do not call this method to join the channel unless you receive the connectionStateDisconnected(1) state.
- -102: The channel name is invalid. You need to pass in a valid channel name in channelId to rejoin the channel.
- -121: The user ID is invalid. You need to pass in a valid user ID in uid to rejoin the channel.
joinChannelWithUserAccount
Join a channel using a user account and token, and set the media options.
Future<void> joinChannelWithUserAccount( {required String token, required String channelId, required String userAccount, ChannelMediaOptions? options});
Before calling this method, if you have not called registerLocalUserAccount to register a user account, when you call this method to join a channel, the SDK automatically creates a user account for you. Calling the registerLocalUserAccount method to register a user account, and then calling this method to join a channel can shorten the time it takes to enter the channel.
Once a user joins the channel, the user subscribes to the audio and video streams of all the other users in the channel by default, giving rise to usage and billings. To stop subscribing to a specified stream or all remote streams, call the corresponding mute methods.
Call timing
Call this method after initialize.
Restrictions
- This method only supports users joining one channel at a time.
- Users with different App IDs cannot call each other.
- Before joining a channel, ensure that the App ID you use to generate a token is the same as that you pass in the initialize method; otherwise, you may fail to join the channel with the token.
Parameters
- token
- The token generated on your server for authentication. See .Note:
- (Recommended) If your project has enabled the security mode (using APP ID and Token for authentication), this parameter is required.
- If you have only enabled the testing mode (using APP ID for authentication), this parameter is optional. You will automatically exit the channel 24 hours after successfully joining in.
- If you need to join different channels at the same time or switch between channels, Agora recommends using a wildcard token so that you don't need to apply for a new token every time joining a channel. See Secure authentication with tokens.
- channelId
-
The channel name. This parameter signifies the channel in which users engage in real-time audio and video interaction. Under the premise of the same App ID, users who fill in the same channel ID enter the same channel for audio and video interaction. The string length must be less than 64 bytes. Supported characters (89 characters in total):
- All lowercase English letters: a to z.
- All uppercase English letters: A to Z.
- All numeric characters: 0 to 9.
- "!", "#", "$", "%", "&", "(", ")", "+", "-", ":", ";", "<", "=", ".", ">", "?", "@", "[", "]", "^", "_", "{", "}", "|", "~", ","
- userAccount
-
The user account. This parameter is used to identify the user in the channel for real-time audio and video engagement. You need to set and manage user accounts yourself and ensure that each user account in the same channel is unique. The maximum length of this parameter is 255 bytes. Ensure that you set this parameter and do not set it as NULL. Supported characters are as follows(89 in total):
- The 26 lowercase English letters: a to z.
- The 26 uppercase English letters: A to Z.
- All numeric characters: 0 to 9.
- Space
- "!", "#", "$", "%", "&", "(", ")", "+", "-", ":", ";", "<", "=", ".", ">", "?", "@", "[", "]", "^", "_", "{", "}", "|", "~", ","
- options
- The channel media options. See ChannelMediaOptions.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
- < 0: Failure.
- -2: The parameter is invalid. For example, the token is invalid, the uid parameter is not set to an integer, or the value of a member in ChannelMediaOptions is invalid. You need to pass in a valid parameter and join the channel again.
- -3: Fails to initialize the RtcEngine object. You need to reinitialize the RtcEngine object.
- -7: The RtcEngine object has not been initialized. You need to initialize the RtcEngine object before calling this method.
- -8: The internal state of the RtcEngine object is wrong. The typical cause is that after calling startEchoTest to start a call loop test, you call this method to join the channel without calling stopEchoTest to stop the test. You need to call stopEchoTest before calling this method.
- -17: The request to join the channel is rejected. The typical cause is that the user is already in the channel. Agora recommends that you use the onConnectionStateChanged callback to see whether the user is in the channel. Do not call this method to join the channel unless you receive the connectionStateDisconnected(1) state.
- -102: The channel name is invalid. You need to pass in a valid channel name in channelId to rejoin the channel.
- -121: The user ID is invalid. You need to pass in a valid user ID in uid to rejoin the channel.
joinChannelWithUserAccountEx
Join a channel using a user account and token, and set the media options.
Future<void> joinChannelWithUserAccountEx( {required String token, required String channelId, required String userAccount, required ChannelMediaOptions options});
Before calling this method, if you have not called registerLocalUserAccount to register a user account, when you call this method to join a channel, the SDK automatically creates a user account for you. Calling the registerLocalUserAccount method to register a user account, and then calling this method to join a channel can shorten the time it takes to enter the channel.
Once a user joins the channel, the user subscribes to the audio and video streams of all the other users in the channel by default, giving rise to usage and billings. If you want to stop subscribing to the media stream of other users, you can set the options parameter or call the corresponding mute method.
Call timing
Call this method after initialize.
Restrictions
- This method only supports users joining one channel at a time.
- Users with different App IDs cannot call each other.
- Before joining a channel, ensure that the App ID you use to generate a token is the same as that you pass in the initialize method; otherwise, you may fail to join the channel with the token.
Parameters
- token
- The token generated on your server for authentication. See .Note:
- (Recommended) If your project has enabled the security mode (using APP ID and Token for authentication), this parameter is required.
- If you have only enabled the testing mode (using APP ID for authentication), this parameter is optional. You will automatically exit the channel 24 hours after successfully joining in.
- If you need to join different channels at the same time or switch between channels, Agora recommends using a wildcard token so that you don't need to apply for a new token every time joining a channel. See Secure authentication with tokens.
- channelId
-
The channel name. This parameter signifies the channel in which users engage in real-time audio and video interaction. Under the premise of the same App ID, users who fill in the same channel ID enter the same channel for audio and video interaction. The string length must be less than 64 bytes. Supported characters (89 characters in total):
- All lowercase English letters: a to z.
- All uppercase English letters: A to Z.
- All numeric characters: 0 to 9.
- "!", "#", "$", "%", "&", "(", ")", "+", "-", ":", ";", "<", "=", ".", ">", "?", "@", "[", "]", "^", "_", "{", "}", "|", "~", ","
- userAccount
-
The user account. This parameter is used to identify the user in the channel for real-time audio and video engagement. You need to set and manage user accounts yourself and ensure that each user account in the same channel is unique. The maximum length of this parameter is 255 bytes. Ensure that you set this parameter and do not set it as NULL. Supported characters are as follows(89 in total):
- The 26 lowercase English letters: a to z.
- The 26 uppercase English letters: A to Z.
- All numeric characters: 0 to 9.
- Space
- "!", "#", "$", "%", "&", "(", ")", "+", "-", ":", ";", "<", "=", ".", ">", "?", "@", "[", "]", "^", "_", "{", "}", "|", "~", ","
- options
- The channel media options. See ChannelMediaOptions.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
- < 0: Failure.
- -2: The parameter is invalid. For example, the token is invalid, the uid parameter is not set to an integer, or the value of a member in ChannelMediaOptions is invalid. You need to pass in a valid parameter and join the channel again.
- -3: Fails to initialize the RtcEngine object. You need to reinitialize the RtcEngine object.
- -7: The RtcEngine object has not been initialized. You need to initialize the RtcEngine object before calling this method.
- -8: The internal state of the RtcEngine object is wrong. The typical cause is that after calling startEchoTest to start a call loop test, you call this method to join the channel without calling stopEchoTest to stop the test. You need to call stopEchoTest before calling this method.
- -17: The request to join the channel is rejected. The typical cause is that the user is already in the channel. Agora recommends that you use the onConnectionStateChanged callback to see whether the user is in the channel. Do not call this method to join the channel unless you receive the connectionStateDisconnected(1) state.
- -102: The channel name is invalid. You need to pass in a valid channel name in channelId to rejoin the channel.
- -121: The user ID is invalid. You need to pass in a valid user ID in uid to rejoin the channel.
leaveChannel
Sets channel options and leaves the channel.
Future<void> leaveChannel({LeaveChannelOptions? options});
After calling this method, the SDK terminates the audio and video interaction, leaves the current channel, and releases all resources related to the session.
After joining the channel, you must call this method to end the call; otherwise, the next call cannot be started. If you have called joinChannelEx to join multiple channels, calling this method will leave all the channels you joined.
Call timing
Call this method after joining a channel.
Restrictions
If you call release immediately after calling this method, the SDK does not trigger the onLeaveChannel callback.
Parameters
- options
- The options for leaving the channel. See LeaveChannelOptions.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
loadExtensionProvider
Loads an extension.
Future<void> loadExtensionProvider( {required String path, bool unloadAfterUse = false});
This method is used to add extensions external to the SDK (such as those from Extensions Marketplace and SDK extensions) to the SDK.
Call timing
Make sure the RtcEngine is initialized before you call this method.
Restrictions
If you want to load multiple extensions, you need to call this method multiple times.
Parameters
- path
- The extension library path and name. For example:
/library/libagora_segmentation_extension.dll
. - unloadAfterUse
- Whether to uninstall the current extension when you no longer using it:
true
: Uninstall the extension when the RtcEngine is destroyed.false
: (Rcommended) Do not uninstall the extension until the process terminates.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
muteAllRemoteAudioStreams
Stops or resumes subscribing to the audio streams of all remote users.
Future<void> muteAllRemoteAudioStreams(bool mute);
After successfully calling this method, the local user stops or resumes subscribing to the audio streams of all remote users, including all subsequent users.
By default, the SDK subscribes to the audio streams of all remote users when joining a channel. To modify this behavior, you can set autoSubscribeAudio to false
when calling joinChannel to join the channel, which will cancel the subscription to the audio streams of all users upon joining the channel.
Call timing
Call this method after joining a channel.
Restrictions
If you call this method and then call enableAudio or disableAudio, the latest call will prevail.
Parameters
- mute
-
Whether to stop subscribing to the audio streams of all remote users:
true
: Stops subscribing to the audio streams of all remote users.false
: (Default) Subscribes to the audio streams of all remote users by default.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
muteAllRemoteVideoStreams
Stops or resumes subscribing to the video streams of all remote users.
Future<void> muteAllRemoteVideoStreams(bool mute);
After successfully calling this method, the local user stops or resumes subscribing to the video streams of all remote users, including all subsequent users.
By default, the SDK subscribes to the video streams of all remote users when joining a channel. To modify this behavior, you can set autoSubscribeVideo tofalse
when calling joinChannel to join the channel, which will cancel the subscription to the video streams of all users upon joining the channel.
Call timing
Call this method after joining a channel.
Restrictions
If you call this method and then call enableVideo or disableVideo, the latest call will prevail.
Parameters
- mute
-
Whether to stop subscribing to the video streams of all remote users.
true
: Stop subscribing to the video streams of all remote users.false
: (Default) Subscribe to the video streams of all remote users by default.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
muteLocalAudioStream
Stops or resumes publishing the local audio stream.
Future<void> muteLocalAudioStream(bool mute);
This method is used to control whether to publish the locally captured audio stream. If you call this method to stop publishing locally captured audio streams, the audio capturing device will still work and won't be affected.
Call timing
This method can be called either before or after joining the channel.
Restrictions
None.
Parameters
- mute
-
Whether to stop publishing the local audio stream:
true
: Stops publishing the local audio stream.false
: (Default) Resumes publishing the local audio stream.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
muteLocalVideoStream
Stops or resumes publishing the local video stream.
Future<void> muteLocalVideoStream(bool mute);
This method is used to control whether to publish the locally captured video stream. If you call this method to stop publishing locally captured video streams, the video capturing device will still work and won't be affected.
Compared to enableLocalVideo(false
), which can also cancel the publishing of local video stream by turning off the local video stream capture, this method responds faster.
Call timing
This method can be called either before or after joining the channel.
Restrictions
None.
Parameters
- mute
-
Whether to stop publishing the local video stream.
true
: Stop publishing the local video stream.false
: (Default) Publish the local video stream.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
muteRecordingSignal
Whether to mute the recording signal.
Future<void> muteRecordingSignal(bool mute);
true
, the SDK behaves as follows:- Records the adjusted volume.
- Mutes the recording signal.
false
, the recording signal volume will be restored to the volume recorded by the SDK before muting.Call timing
This method can be called either before or after joining the channel.
Restrictions
None.
Parameters
- mute
-
true
: Mute the recording signal.false
: (Default) Do not mute the recording signal.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
muteRemoteAudioStream
Stops or resumes subscribing to the audio stream of a specified user.
Future<void> muteRemoteAudioStream({required int uid, required bool mute});
Call timing
Call this method after joining a channel.
Restrictions
None.
Parameters
- uid
- The user ID of the specified user.
- mute
-
Whether to subscribe to the specified remote user's audio stream.
true
: Stop subscribing to the audio stream of the specified user.false
: (Default) Subscribe to the audio stream of the specified user.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
muteRemoteVideoStream
Stops or resumes subscribing to the video stream of a specified user.
Future<void> muteRemoteVideoStream({required int uid, required bool mute});
Call timing
Call this method after joining a channel.
Restrictions
None.
Parameters
- uid
- The user ID of the specified user.
- mute
-
Whether to subscribe to the specified remote user's video stream.
true
: Stop subscribing to the video streams of the specified user.false
: (Default) Subscribe to the video stream of the specified user.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
- < 0: Failure.
pauseAllChannelMediaRelay
Pauses the media stream relay to all target channels.
Future<void> pauseAllChannelMediaRelay();
Details
After the cross-channel media stream relay starts, you can call this method to pause relaying media streams to all target channels; after the pause, if you want to resume the relay, call resumeAllChannelMediaRelay.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
pauseAllEffects
Pauses all audio effects.
Future<void> pauseAllEffects();
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
pauseAudioMixing
Pauses playing and mixing the music file.
Future<void> pauseAudioMixing();
After calling startAudioMixing to play a music file, you can call this method to pause the playing. If you need to stop the playback, call stopAudioMixing.
Call timing
Call this method after joining a channel.
Restrictions
None.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
pauseEffect
Pauses a specified audio effect file.
Future<void> pauseEffect(int soundId);
Parameters
- soundId
- The audio effect ID. The ID of each audio effect file is unique.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
playAllEffects
Plays all audio effect files.
Future<void> playAllEffects( {required int loopCount, required double pitch, required double pan, required int gain, bool publish = false});
Details
After calling preloadEffect multiple times to preload multiple audio effects into the memory, you can call this method to play all the specified audio effects for all users in the channel.
Parameters
- loopCount
- The number of times the audio effect loops:
- -1: Play the audio effect files in an indefinite loop until you call stopEffect or stopAllEffects.
- 0: Play the audio effect once.
- 1: Play the audio effect twice.
- pitch
-
The pitch of the audio effect. The value ranges between 0.5 and 2.0. The default value is 1.0 (original pitch). The lower the value, the lower the pitch.
- pan
- The spatial position of the audio effect. The value ranges between -1.0 and 1.0:
- -1.0: The audio effect shows on the left.
- 0: The audio effect shows ahead.
- 1.0: The audio effect shows on the right.
- gain
-
The volume of the audio effect. The value range is [0, 100]. The default value is 100 (original volume). The smaller the value, the lower the volume.
- publish
- Whether to publish the audio effect to the remote users:
true
: Publish the audio effect to the remote users. Both the local user and remote users can hear the audio effect.false
: (Default) Do not publish the audio effect to the remote users. Only the local user can hear the audio effect.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
playEffect
Plays the specified local or online audio effect file.
Future<void> playEffect( {required int soundId, required String filePath, required int loopCount, required double pitch, required double pan, required int gain, bool publish = false, int startPos = 0});
To play multiple audio effect files at the same time, call this method multiple times with different soundId and filePath. To achieve the optimal user experience, Agora recommends that you do not playing more than three audio files at the same time.
Call timing
You can call this method either before or after joining a channel.
Restrictions
If you need to play an online audio effect file, Agora recommends that you cache the online audio effect file to your local device, call preloadEffect to preload the file into memory, and then call this method to play the audio effect. Otherwise, you might encounter playback failures or no sound during playback due to loading timeouts or failures.
Parameters
- soundId
- The audio effect ID. The ID of each audio effect file is unique.Attention: If you have preloaded an audio effect into memory by calling preloadEffect, ensure that the value of this parameter is the same as that of soundId in preloadEffect.
- filePath
-
The file path. The SDK supports URLs and absolute path of local files. The absolute path needs to be accurate to the file name and extension. Supported audio formats include MP3, AAC, M4A, MP4, WAV, and 3GP.
Attention: If you have preloaded an audio effect into memory by calling preloadEffect, ensure that the value of this parameter is the same as that of filePath in preloadEffect. - loopCount
-
The number of times the audio effect loops.
- ≥ 0: The number of playback times. For example, 1 means looping one time, which means playing the audio effect two times in total.
- -1: Play the audio file in an infinite loop.
- pitch
- The pitch of the audio effect. The value range is 0.5 to 2.0. The default value is 1.0, which means the original pitch. The lower the value, the lower the pitch.
- pan
-
The spatial position of the audio effect. The value ranges between -1.0 and 1.0:
- -1.0: The audio effect is heard on the left of the user.
- 0.0: The audio effect is heard in front of the user.
- 1.0: The audio effect is heard on the right of the user.
- gain
- The volume of the audio effect. The value range is 0.0 to 100.0. The default value is 100.0, which means the original volume. The smaller the value, the lower the volume.
- publish
-
Whether to publish the audio effect to the remote users:
true
: Publish the audio effect to the remote users. Both the local user and remote users can hear the audio effect.false
: Do not publish the audio effect to the remote users. Only the local user can hear the audio effect.
- startPos
-
The playback position (ms) of the audio effect file.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
- < 0: Failure.
preloadChannel
Preloads a channel with token, channelId, and uid.
Future<void> preloadChannel( {required String token, required String channelId, required int uid});
When audience members need to switch between different channels frequently, calling the method can help shortening the time of joining a channel, thus reducing the time it takes for audience members to hear and see the host.
If you join a preloaded channel, leave it and want to rejoin the same channel, you do not need to call this method unless the token for preloading the channel expires.
Call timing
To improve the user experience of preloading channels, Agora recommends that before joining the channel, calling this method as early as possible once confirming the channel name and user information.
Restrictions
- When calling this method, ensure you set the user role as audience and do not set the audio scenario as audioScenarioChorus, otherwise, this method does not take effect.
- You also need to make sure that the channel name, user ID and token passed in for preloading are the same as the values passed in when joinning the channel, otherwise, this method does not take effect.
- One RtcEngine instance supports preloading 20 channels at most. When exceeding this limit, the latest 20 preloaded channels take effect.
Parameters
- token
- The token generated on your server for authentication. See .When the token for preloading channels expires, you can update the token based on the number of channels you preload.
- When preloading one channel, calling this method to pass in the new token.
- When preloading more than one channels:
- If you use a wildcard token for all preloaded channels, call updatePreloadChannelToken to update the token.Note: When generating a wildcard token, ensure the user ID is not set as 0. See Secure authentication with tokens.
- If you use different tokens to preload different channels, call this method to pass in your user ID, channel name and the new token.
- If you use a wildcard token for all preloaded channels, call updatePreloadChannelToken to update the token.
- channelId
- The channel name that you want to preload. This parameter signifies the channel in which users engage in real-time audio and video interaction. Under the premise of the same App ID, users who fill in the same channel ID enter the same channel for audio and video interaction. The string length must be less than 64 bytes. Supported characters (89 characters in total):
- All lowercase English letters: a to z.
- All uppercase English letters: A to Z.
- All numeric characters: 0 to 9.
- "!", "#", "$", "%", "&", "(", ")", "+", "-", ":", ";", "<", "=", ".", ">", "?", "@", "[", "]", "^", "_", "{", "}", "|", "~", ","
- uid
- The user ID. This parameter is used to identify the user in the channel for real-time audio and video interaction. You need to set and manage user IDs yourself, and ensure that each user ID in the same channel is unique. This parameter is a 32-bit unsigned integer. The value range is 1 to 232-1. If the user ID is not assigned (or set to 0), the SDK assigns a random user ID and onJoinChannelSuccess returns it in the callback. Your application must record and maintain the returned user ID, because the SDK does not do so.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
- < 0: Failure.
- -7: The RtcEngine object has not been initialized. You need to initialize the RtcEngine object before calling this method.
- -102: The channel name is invalid. You need to pass in a valid channel name and join the channel again.
preloadChannelWithUserAccount
Preloads a channel with token, channelId, and userAccount.
Future<void> preloadChannelWithUserAccount( {required String token, required String channelId, required String userAccount});
When audience members need to switch between different channels frequently, calling the method can help shortening the time of joining a channel, thus reducing the time it takes for audience members to hear and see the host.
If you join a preloaded channel, leave it and want to rejoin the same channel, you do not need to call this method unless the token for preloading the channel expires.
Call timing
To improve the user experience of preloading channels, Agora recommends that before joining the channel, calling this method as early as possible once confirming the channel name and user information.
Restrictions
- When calling this method, ensure you set the user role as audience and do not set the audio scenario as audioScenarioChorus, otherwise, this method does not take effect.
- You also need to make sure that the User Account, channel ID and token passed in for preloading are the same as the values passed in when joining the channel, otherwise, this method does not take effect.
- One RtcEngine instance supports preloading 20 channels at most. When exceeding this limit, the latest 20 preloaded channels take effect.
Parameters
- token
- The token generated on your server for authentication. See .When the token for preloading channels expires, you can update the token based on the number of channels you preload.
- When preloading one channel, calling this method to pass in the new token.
- When preloading more than one channels:
- If you use a wildcard token for all preloaded channels, call updatePreloadChannelToken to update the token.Note: When generating a wildcard token, ensure the user ID is not set as 0. See Secure authentication with tokens.
- If you use different tokens to preload different channels, call this method to pass in your user ID, channel name and the new token.
- If you use a wildcard token for all preloaded channels, call updatePreloadChannelToken to update the token.
- channelId
- The channel name that you want to preload. This parameter signifies the channel in which users engage in real-time audio and video interaction. Under the premise of the same App ID, users who fill in the same channel ID enter the same channel for audio and video interaction. The string length must be less than 64 bytes. Supported characters (89 characters in total):
- All lowercase English letters: a to z.
- All uppercase English letters: A to Z.
- All numeric characters: 0 to 9.
- "!", "#", "$", "%", "&", "(", ")", "+", "-", ":", ";", "<", "=", ".", ">", "?", "@", "[", "]", "^", "_", "{", "}", "|", "~", ","
- userAccount
-
The user account. This parameter is used to identify the user in the channel for real-time audio and video engagement. You need to set and manage user accounts yourself and ensure that each user account in the same channel is unique. The maximum length of this parameter is 255 bytes. Ensure that you set this parameter and do not set it as NULL. Supported characters are as follows(89 in total):
- The 26 lowercase English letters: a to z.
- The 26 uppercase English letters: A to Z.
- All numeric characters: 0 to 9.
- Space
- "!", "#", "$", "%", "&", "(", ")", "+", "-", ":", ";", "<", "=", ".", ">", "?", "@", "[", "]", "^", "_", "{", "}", "|", "~", ","
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
- < 0: Failure.
- -2: The parameter is invalid. For example, the User Account is empty. You need to pass in a valid parameter and join the channel again.
- -7: The RtcEngine object has not been initialized. You need to initialize the RtcEngine object before calling this method.
- -102: The channel name is invalid. You need to pass in a valid channel name and join the channel again.
preloadEffect
Preloads a specified audio effect file into the memory.
Future<void> preloadEffect( {required int soundId, required String filePath, int startPos = 0});
Ensure the size of all preloaded files does not exceed the limit.
For the audio file formats supported by this method, see What formats of audio files does the Agora RTC SDK support.
Call timing
Agora recommends that you call this method before joining a channel.
Restrictions
None.
Parameters
- soundId
- The audio effect ID. The ID of each audio effect file is unique.
- filePath
- File path:
- Android: The file path, which needs to be accurate to the file name and suffix. Agora supports URL addresses, absolute paths, or file paths that start with
/assets/
. You might encounter permission issues if you use an absolute path to access a local file, so Agora recommends using a URI address instead. For example: content://com.android.providers.media.documents/document/audio%3A14441
- Windows: The absolute path or URL address (including the suffixes of the filename) of the audio effect file. For example
: C:\music\audio.mp4
. - iOS or macOS: The absolute path or URL address (including the suffixes of the filename) of the audio effect file. For example:
/var/mobile/Containers/Data/audio.mp4
.
- Android: The file path, which needs to be accurate to the file name and suffix. Agora supports URL addresses, absolute paths, or file paths that start with
- startPos
- The playback position (ms) of the audio effect file.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
queryCameraFocalLengthCapability
Queries the focal length capability supported by the camera.
Future<List<FocalLengthInfo>> queryCameraFocalLengthCapability();
Details
If you want to enable the wide-angle or ultra-wide-angle mode for camera capture, it is recommended to start by calling this method to check whether the device supports the required focal length capability. Then, adjust the camera's focal length configuration based on the query result by calling setCameraCapturerConfiguration, ensuring the best camera capture performance.
Exceptions
Returns an array of FocalLengthInfo objects, which contain the camera's orientation and focal length type.
queryCodecCapability
Queries the video codec capabilities of the SDK.
Future<List<CodecCapInfo>> queryCodecCapability(int size);
Details
Parameters
- size
- The size of CodecCapInfo.
Returns
- One CodecCapInfo array indicating the video encoding capability of the device, if the method call succeeds.
- If the call timeouts, please modify the call logic and do not invoke the method in the main thread.
queryDeviceScore
Queries device score.
Future<int> queryDeviceScore();
Details
Applicable scenarios
In high-definition or ultra-high-definition video scenarios, you can first call this method to query the device's score. If the returned score is low (for example, below 60), you need to lower the video resolution to avoid affecting the video experience. The minimum device score required for different business scenarios is varied. For specific score recommendations, please technical support.
Exceptions
When the method call succeeds, it returns a value in the range of [0,100], indicating the current device's score. The larger the value, the stronger the device capability. Most devices are rated between 60 and 100. When the method call fails, the AgoraRtcException exception is thrown; and you need to catch the exception and handle it accordingly.
- < 0: Failure.
queryScreenCaptureCapability
Queries the highest frame rate supported by the device during screen sharing.
Future<int> queryScreenCaptureCapability();
Details
Applicable scenarios
This method is for Android and iOS only.
To ensure optimal screen sharing performance, particularly in enabling high frame rates like 60 fps, Agora recommends you to query the device's maximum supported frame rate using this method beforehand. This way, if the device cannot support such a high frame rate, you can adjust the screen sharing stream accordingly to avoid any negative impact on the sharing quality. If the device does not support high frame rate, you can reduce the frame rate of the screen sharing stream appropriately when sharing the screen to ensure that the sharing effect meets your expectation.
Exceptions
- The highest frame rate supported by the device, if the method is called successfully. See ScreenCaptureFramerateCapability.
- < 0: Failure.
rate
Allows a user to rate a call after the call ends.
Future<void> rate( {required String callId, required int rating, required String description});
Details
Parameters
- callId
- The current call ID. You can get the call ID by calling getCallId.
- rating
- The value is between 1 (the lowest score) and 5 (the highest score).
- description
- A description of the call. The string length should be less than 800 bytes.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
registerAudioEncodedFrameObserver
Registers an encoded audio observer.
void registerAudioEncodedFrameObserver( {required AudioEncodedFrameObserverConfig config, required AudioEncodedFrameObserver observer});
Details
- Call this method after joining a channel.
- You can call this method or startAudioRecording to set the recording type and quality of audio files, but Agora does not recommend using this method and startAudioRecording at the same time. Only the method called later will take effect.
Parameters
- config
- Observer settings for the encoded audio. See AudioEncodedFrameObserverConfig.
- observer
- The encoded audio observer. See AudioEncodedFrameObserver.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
registerAudioSpectrumObserver
Register an audio spectrum observer.
void registerAudioSpectrumObserver(AudioSpectrumObserver observer);
Details
After successfully registering the audio spectrum observer and calling enableAudioSpectrumMonitor to enable the audio spectrum monitoring, the SDK reports the callback that you implement in the AudioSpectrumObserver class according to the time interval you set.
Parameters
- observer
-
The audio spectrum observer. See AudioSpectrumObserver.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
registerExtension
Registers an extension.
Future<void> registerExtension( {required String provider, required String extension, MediaSourceType type = MediaSourceType.unknownMediaSource});
For extensions external to the SDK (such as those from Extensions Marketplace and SDK Extensions), you need to load them before calling this method. Extensions internal to the SDK (those included in the full SDK package) are automatically loaded and registered after the initialization of RtcEngine.
Call timing
- Agora recommends you call this method after the initialization of RtcEngine and before joining a channel.
- For video extensions (such as the image enhancement extension), you need to call this method after enabling the video module by calling enableVideo or enableLocalVideo.
- Before calling this method, you need to call loadExtensionProvider to load the extension first.
Restrictions
- If you want to register multiple extensions, you need to call this method multiple times.
- The data processing order of different extensions in the SDK is determined by the order in which the extensions are registered. That is, the extension that is registered first will process the data first.
Parameters
- provider
- The name of the extension provider.
- extension
- The name of the extension.
- type
- Source type of the extension. See MediaSourceType.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
registerEventHandler
Adds event handlers
void registerEventHandler(RtcEngineEventHandler eventHandler);
Details
The SDK uses the RtcEngineEventHandler class to send callbacks to the app. The app inherits the methods of this class to receive these callbacks. All methods in this class have default (empty) implementations. Therefore, apps only need to inherits callbacks according to the scenarios. In the callbacks, avoid time-consuming tasks or calling APIs that can block the thread, such as the sendStreamMessage method. Otherwise, the SDK may not work properly.
Parameters
- eventHandler
- Callback events to be added. See RtcEngineEventHandler.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
registerLocalUserAccount
Registers a user account.
Future<void> registerLocalUserAccount( {required String appId, required String userAccount});
Once registered, the user account can be used to identify the local user when the user joins the channel. After the registration is successful, the user account can identify the identity of the local user, and the user can use it to join the channel.
- Call the registerLocalUserAccount method to register a user account, and then call the joinChannelWithUserAccount method to join a channel, which can shorten the time it takes to enter the channel.
- Call the joinChannelWithUserAccount method to join a channel.
- Ensure that the userAccount is unique in the channel.
- To ensure smooth communication, use the same parameter type to identify the user. For example, if a user joins the channel with a UID, then ensure all the other users use the UID too. The same applies to the user account. If a user joins the channel with the Agora Web SDK, ensure that the ID of the user is set to the same parameter type.
Restrictions
None.
Parameters
- appId
- The App ID of your project on Agora Console.
- userAccount
-
The user account. This parameter is used to identify the user in the channel for real-time audio and video engagement. You need to set and manage user accounts yourself and ensure that each user account in the same channel is unique. The maximum length of this parameter is 255 bytes. Ensure that you set this parameter and do not set it as NULL. Supported characters are as follow(89 in total):
- The 26 lowercase English letters: a to z.
- The 26 uppercase English letters: A to Z.
- All numeric characters: 0 to 9.
- Space
- "!", "#", "$", "%", "&", "(", ")", "+", "-", ":", ";", "<", "=", ".", ">", "?", "@", "[", "]", "^", "_", "{", "}", "|", "~", ","
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
registerMediaMetadataObserver
Registers the metadata observer.
void registerMediaMetadataObserver( {required MetadataObserver observer, required MetadataType type});
Details
You need to implement the MetadataObserver class and specify the metadata type in this method. This method enables you to add synchronized metadata in the video stream for more diversified live interactive streaming, such as sending shopping links, digital coupons, and online quizzes.
Parameters
- observer
- The metadata observer. See MetadataObserver.
- type
-
The metadata type. The SDK currently only supports videoMetadata.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
- < 0: Failure.
release
Releases the RtcEngine instance.
Future<void> release({bool sync = false});
Details
This method releases all resources used by the Agora SDK. Use this method for apps in which users occasionally make voice or video calls. When users do not make calls, you can free up resources for other operations.
After a successful method call, you can no longer use any method or callback in the SDK anymore. If you want to use the real-time communication functions again, you must call createAgoraRtcEngine and initialize to create a new RtcEngine instance.
- This method can be called synchronously. You need to wait for the resource of RtcEngine to be released before performing other operations (for example, create a new RtcEngine object). Therefore, Agora recommends calling this method in the child thread to avoid blocking the main thread.
- Besides, Agora does not recommend you calling release in any callback of the SDK. Otherwise, the SDK cannot release the resources until the callbacks return results, which may result in a deadlock.
Parameters
- sync
-
Whether the method is called synchronously:
true
: Synchronous call.false
: Asynchronous call. Currently this method only supports synchronous calls. Do not set this parameter to this value.
unregisterEventHandler
Removes the specified callback events.
void unregisterEventHandler(RtcEngineEventHandler eventHandler);
Details
You can call this method too remove all added callback events.
Parameters
- eventHandler
- Callback events to be removed. See RtcEngineEventHandler.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
renewToken
Renews the token.
Future<void> renewToken(String token);
You can call this method to pass a new token to the SDK. A token will expire after a certain period of time, at which point the SDK will be unable to establish a connection with the server.
Call timing
- Receiving the onTokenPrivilegeWillExpire callback reporting the token is about to expire.
- Receiving the onRequestToken callback reporting the token has expired.
- Receiving the onConnectionStateChanged callback reporting connectionChangedTokenExpired(9).
Restrictions
None.
Parameters
- token
- The new token.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
resumeAllChannelMediaRelay
Resumes the media stream relay to all target channels.
Future<void> resumeAllChannelMediaRelay();
Details
After calling the pauseAllChannelMediaRelay method, you can call this method to resume relaying media streams to all destination channels.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
- < 0: Failure.
- -5: The method call was rejected. There is no paused channel media relay.
resumeAllEffects
Resumes playing all audio effect files.
Future<void> resumeAllEffects();
After you call pauseAllEffects to pause the playback, you can call this method to resume the playback.
Call timing
Call this method after pauseAllEffects.
Restrictions
None.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
resumeAudioMixing
Resumes playing and mixing the music file.
Future<void> resumeAudioMixing();
After calling pauseAudioMixing to pause the playback, you can call this method to resume the playback.
Call timing
Call this method after joining a channel.
Restrictions
None.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
resumeEffect
Resumes playing a specified audio effect.
Future<void> resumeEffect(int soundId);
Parameters
- soundId
- The audio effect ID. The ID of each audio effect file is unique.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
selectAudioTrack
Selects the audio track used during playback.
Future<void> selectAudioTrack(int index);
Details
After getting the track index of the audio file, you can call this method to specify any track to play. For example, if different tracks of a multi-track file store songs in different languages, you can call this method to set the playback language.
- For the supported formats of audio files, see https://docs.agora.io/en/help/general-product-inquiry/audio_format#extended-audio-file-formats.
- You need to call this method after calling startAudioMixing and receiving the onAudioMixingStateChanged
(audioMixingStatePlaying)
callback.
Parameters
- index
- The audio track you want to specify. The value should be greater than 0 and less than that of returned by getAudioTrackCount.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
selectMultiAudioTrack
Selects the audio tracks that you want to play on your local device and publish to the channel respectively.
Future<void> selectMultiAudioTrack( {required int playoutTrackIndex, required int publishTrackIndex});
Details
You can call this method to determine the audio track to be played on your local device and published to the channel.
Before calling this method, you need to open the media file with the openWithMediaSource method and set enableMultiAudioTrack in MediaSource as true
.
Applicable scenarios
For example, in KTV scenarios, the host can choose to play the original sound locally and publish the accompaniment track to the channel.
Parameters
- playoutTrackIndex
- The index of audio tracks for local playback. You can obtain the index through getStreamInfo.
- publishTrackIndex
- The index of audio tracks to be published in the channel. You can obtain the index through getStreamInfo.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
- < 0: Failure.
sendCustomReportMessage
Reports customized messages.
Future<void> sendCustomReportMessage( {required String id, required String category, required String event, required String label, required int value});
Details
Agora supports reporting and analyzing customized messages. This function is in the beta stage with a free trial. The ability provided in its beta test version is reporting a maximum of 10 message pieces within 6 seconds, with each message piece not exceeding 256 bytes and each string not exceeding 100 bytes. To try out this function, contact support@agora.io and discuss the format of customized messages with us.
sendMetaData
Sends media metadata.
Future<void> sendMetaData( {required Metadata metadata, required VideoSourceType sourceType});
Details
If the metadata is sent successfully, the SDK triggers the onMetadataReceived callback on the receiver.
Parameters
- metadata
- Media metadata. See Metadata.
- sourceType
- The type of the video source. See VideoSourceType.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
- < 0: Failure.
sendStreamMessage
Sends data stream messages.
Future<void> sendStreamMessage( {required int streamId, required Uint8List data, required int length});
Details
After calling createDataStream, you can call this method to send data stream messages to all users in the channel.
- Each client within the channel can have up to 5 data channels simultaneously, with a total shared packet bitrate limit of 30 KB/s for all data channels.
- Each data channel can send up to 60 packets per second, with each packet being a maximum of 1 KB.
A successful method call triggers the onStreamMessage callback on the remote client, from which the remote user gets the stream message. A failed method call triggers the onStreamMessageError callback on the remote client.
- This method needs to be called after createDataStream and joining the channel.
- In live streaming scenarios, this method only applies to hosts.
Parameters
- streamId
- The data stream ID. You can get the data stream ID by calling createDataStream.
- data
- The message to be sent.
- length
- The length of the data.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setAdvancedAudioOptions
Sets audio advanced options.
Future<void> setAdvancedAudioOptions(AdvancedAudioOptions options);
Details
If you have advanced audio processing requirements, such as capturing and sending stereo audio, you can call this method to set advanced audio options.
Parameters
- options
- The advanced options for audio. See AdvancedAudioOptions.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setAINSMode
Sets whether to enable the AI ​​noise suppression function and set the noise suppression mode.
Future<void> setAINSMode( {required bool enabled, required AudioAinsMode mode});
- Television;
- Air conditioner;
- Machinery, etc.
- Thunder;
- Explosion;
- Cracking, etc.
Applicable scenarios
In scenarios such as co-streaming, online education and video meeting, this function can detect and reduce background noises to improve experience.
Call timing
You can call this method either before or after joining a channel.
Restrictions
- This method relies on the AI noise suppression dynamic library. If the dynamic library is deleted, the function cannot be enabled. For the name of the AI ​​noise suppression dynamic library, see App size optimization.
- Agora does not recommend enabling this function on devices running Android 6.0 and below.
Parameters
- enabled
- Whether to enable the AI noise suppression function:
true
: Enable the AI noise suppression.false
: (Default) Disable the AI noise suppression.
- mode
-
The AI noise suppression modes. See AudioAinsMode.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setAudioEffectParameters
Sets parameters for SDK preset audio effects.
Future<void> setAudioEffectParameters( {required AudioEffectPreset preset, required int param1, required int param2});
Details
- 3D voice effect: Sets the cycle period of the 3D voice effect.
- Pitch correction effect: Sets the basic mode and tonic pitch of the pitch correction effect. Different songs have different modes and tonic pitches. Agora recommends bounding this method with interface elements to enable users to adjust the pitch correction interactively.
After setting the audio parameters, all users in the channel can hear the effect.
- Call setAudioScenario to set the audio scenario to high-quality audio scenario, namely audioScenarioGameStreaming(3).
- Call setAudioProfile to set the profile parameter to audioProfileMusicHighQuality(4) or audioProfileMusicHighQualityStereo(5).
- You can call this method either before or after joining a channel.
- Do not set the profile parameter in setAudioProfile to audioProfileSpeechStandard(1) or audioProfileIot(6), or the method does not take effect.
- This method has the best effect on human voice processing, and Agora does not recommend calling this method to process audio data containing music.
- After calling setAudioEffectParameters, Agora does not recommend you to call the following methods, otherwise the effect set by setAudioEffectParameters will be overwritten:
- This method relies on the voice beautifier dynamic library
libagora_audio_beauty_extension.dll
. If the dynamic library is deleted, the function cannot be enabled normally.
Parameters
- preset
- The options for SDK preset audio effects:
- roomAcoustics3dVoice, 3D voice effect:
- You need to set the profile parameter in setAudioProfile to audioProfileMusicStandardStereo(3) or audioProfileMusicHighQualityStereo(5) before setting this enumerator; otherwise, the enumerator setting does not take effect.
- If the 3D voice effect is enabled, users need to use stereo audio playback devices to hear the anticipated voice effect.
- pitchCorrection, Pitch correction effect:
- roomAcoustics3dVoice, 3D voice effect:
- param1
-
- If you set preset to roomAcoustics3dVoice, param1 sets the cycle period of the 3D voice effect. The value range is [1,60] and the unit is seconds. The default value is 10, indicating that the voice moves around you every 10 seconds.
- If you set preset to pitchCorrection, param1 indicates the basic mode of the pitch correction effect:
1
: (Default) Natural major scale.2
: Natural minor scale.3
: Japanese pentatonic scale.
- param2
-
- If you set preset to roomAcoustics3dVoice , you need to set param2 to
0
. - If you set preset to pitchCorrection, param2 indicates the tonic pitch of the pitch correction effect:
1
: A2
: A#3
: B4
: (Default) C5
: C#6
: D7
: D#8
: E9
: F10
: F#11
: G12
: G#
- If you set preset to roomAcoustics3dVoice , you need to set param2 to
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setAudioEffectPreset
Sets an SDK preset audio effect.
Future<void> setAudioEffectPreset(AudioEffectPreset preset);
Call this method to set an SDK preset audio effect for the local user who sends an audio stream. This audio effect does not change the gender characteristics of the original voice. After setting an audio effect, all users in the channel can hear the effect.
Call timing
This method can be called either before or after joining the channel.
- Call setAudioScenario to set the audio scenario to high-quality audio scenario, namely audioScenarioGameStreaming(3).
- Call setAudioProfile to set the profile parameter to audioProfileMusicHighQuality(4) or audioProfileMusicHighQualityStereo(5).
Restrictions
- Do not set the profile parameter in setAudioProfile to audioProfileSpeechStandard(1) or audioProfileIot(6), or the method does not take effect.
- If you call setAudioEffectPreset and set enumerators except for roomAcoustics3dVoice or pitchCorrection, do not call setAudioEffectParameters; otherwise, setAudioEffectPreset is overridden.
- After calling setAudioEffectPreset, Agora does not recommend you to call the following methods, otherwise the effect set by setAudioEffectPreset will be overwritten:
- This method relies on the voice beautifier dynamic library
libagora_audio_beauty_extension.dll
. If the dynamic library is deleted, the function cannot be enabled normally.
Parameters
- preset
- The options for SDK preset audio effects. See AudioEffectPreset.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setAudioMixingDualMonoMode
Sets the channel mode of the current audio file.
Future<void> setAudioMixingDualMonoMode(AudioMixingDualMonoMode mode);
In a stereo music file, the left and right channels can store different audio data. According to your needs, you can set the channel mode to original mode, left channel mode, right channel mode, or mixed channel mode.
Applicable scenarios
- If you only want to hear the accompaniment, use this method to set the audio file's channel mode to left channel mode.
- If you need to hear both the accompaniment and the original vocals simultaneously, call this method to set the channel mode to mixed mode.
Call timing
Call this method after startAudioMixing and receiving the onAudioMixingStateChanged(audioMixingStatePlaying)
callback.
Restrictions
This method only applies to stereo audio files.
Parameters
- mode
- The channel mode. See AudioMixingDualMonoMode.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setAudioMixingPitch
Sets the pitch of the local music file.
Future<void> setAudioMixingPitch(int pitch);
When a local music file is mixed with a local human voice, call this method to set the pitch of the local music file only.
Call timing
You need to call this method after calling startAudioMixing and receiving the onAudioMixingStateChanged(audioMixingStatePlaying)
callback.
Restrictions
None.
Parameters
- pitch
- Sets the pitch of the local music file by the chromatic scale. The default value is 0, which means keeping the original pitch. The value ranges from -12 to 12, and the pitch value between consecutive values is a chromatic value. The greater the absolute value of this parameter, the higher or lower the pitch of the local music file.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setAudioMixingPlaybackSpeed
Sets the playback speed of the current audio file.
Future<void> setAudioMixingPlaybackSpeed(int speed);
Details
Ensure you call this method after calling startAudioMixing receiving the onAudioMixingStateChanged callback reporting the state as audioMixingStatePlaying.
Parameters
- speed
- The playback speed. Agora recommends that you set this to a value between 50 and 400, defined as follows:
- 50: Half the original speed.
- 100: The original speed.
- 400: 4 times the original speed.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setAudioMixingPosition
Sets the audio mixing position.
Future<void> setAudioMixingPosition(int pos);
Call this method to set the playback position of the music file to a different starting position (the default plays from the beginning).
Call timing
Call this method after startAudioMixing and receiving the onAudioMixingStateChanged(audioMixingStatePlaying)
callback.
Restrictions
None.
Parameters
- pos
- Integer. The playback position (ms).
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setAudioProfile
Sets the audio profile and audio scenario.
Future<void> setAudioProfile( {required AudioProfileType profile, AudioScenarioType scenario = AudioScenarioType.audioScenarioDefault});
Applicable scenarios
This method is suitable for various audio scenarios. You can choose as needed. For example, in scenarios with high audio quality requirements such as music teaching, it is recommended to set profile to audioProfileMusicHighQuality
(4) and scenario to audioScenarioGameStreaming
(3).
Call timing
You can call this method either before or after joining a channel.
Restrictions
Due to iOS system restrictions, some audio routes cannot be recognized in call volume mode. Therefore, if you need to use an external sound card, it is recommended to set the audio scenario to audioScenarioGameStreaming
(3). In this scenario, the SDK will switch to media volume to avoid this issue.
Parameters
- profile
-
The audio profile, including the sampling rate, bitrate, encoding mode, and the number of channels. See AudioProfileType.
- scenario
- The audio scenarios. Under different audio scenarios, the device uses different volume types. See AudioScenarioType.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setAudioScenario
Sets audio scenarios.
Future<void> setAudioScenario(AudioScenarioType scenario);
Applicable scenarios
This method is suitable for various audio scenarios. You can choose as needed. For example, in scenarios such as music teaching that require high sound quality, it is recommended to set scenario to audioScenarioGameStreaming
(3).
Call timing
You can call this method either before or after joining a channel.
Restrictions
Due to iOS system restrictions, some audio routes cannot be recognized in call volume mode. Therefore, if you need to use an external sound card, it is recommended to set the audio scenario to audioScenarioGameStreaming
(3). In this scenario, the SDK will switch to media volume to avoid this issue.
Parameters
- scenario
- The audio scenarios. Under different audio scenarios, the device uses different volume types. See AudioScenarioType.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setAudioSessionOperationRestriction
Sets the operational permission of the SDK on the audio session.
Future<void> setAudioSessionOperationRestriction( AudioSessionOperationRestriction restriction);
Details
The SDK and the app can both configure the audio session by default. If you need to only use the app to configure the audio session, this method restricts the operational permission of the SDK on the audio session.
You can call this method either before or after joining a channel. Once you call this method to restrict the operational permission of the SDK on the audio session, the restriction takes effect when the SDK needs to change the audio session.
- This method is only available for iOS platforms.
- This method does not restrict the operational permission of the app on the audio session.
Parameters
- restriction
- The operational permission of the SDK on the audio session. See AudioSessionOperationRestriction. This parameter is in bit mask format, and each bit corresponds to a permission.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setBeautyEffectOptions
Sets the image enhancement options.
Future<void> setBeautyEffectOptions( {required bool enabled, required BeautyOptions options, MediaSourceType type = MediaSourceType.primaryCameraSource});
Enables or disables image enhancement, and sets the options.
Call timing
Call this method after calling enableVideo or startPreview.
Restrictions
- This method relies on the image enhancement dynamic library
libagora_clear_vision_extension.dll
. If the dynamic library is deleted, the function cannot be enabled normally. - This feature has high requirements on device performance. When calling this method, the SDK automatically checks the capabilities of the current device.
Parameters
- enabled
- Whether to enable the image enhancement function:
true
: Enable the image enhancement function.false
: (Default) Disable the image enhancement function.
- options
- The image enhancement options. See BeautyOptions.
- type
- The type of the media source to which the filter effect is applied. See MediaSourceType.Attention: In this method, this parameter supports only the following two settings:
- Use the default value primaryCameraSource if you use camera to capture local video.
- Set this parameter to customVideoSource if you use custom video source.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setCameraAutoFocusFaceModeEnabled
Enables the camera auto-face focus function.
Future<void> setCameraAutoFocusFaceModeEnabled(bool enabled);
By default, the SDK disables face autofocus on Android and enables face autofocus on iOS. To set face autofocus, call this method.
Call timing
This method must be called after the SDK triggers the onLocalVideoStateChanged callback and returns the local video state as localVideoStreamStateCapturing (1).
Restrictions
None.
Parameters
- enabled
-
Whether to enable face autofocus:
true
: Enable the camera auto-face focus function.false
: Disable face autofocus.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setCameraAutoExposureFaceModeEnabled
Sets whether to enable auto exposure.
Future<void> setCameraAutoExposureFaceModeEnabled(bool enabled);
Details
- This method applies to iOS only.
- You must call this method after enableVideo. The setting result will take effect after the camera is successfully turned on, that is, after the SDK triggers the onLocalVideoStateChanged callback and returns the local video state as localVideoStreamStateCapturing (1).
Parameters
- enabled
-
Whether to enable auto exposure:
true
: Enable auto exposure.false
: Disable auto exposure.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setCameraCapturerConfiguration
Sets the camera capture configuration.
Future<void> setCameraCapturerConfiguration( CameraCapturerConfiguration config);
Call timing
Call this method before enabling local camera capture, such as before calling startPreview and joinChannel.
Restrictions
To adjust the camera focal length configuration, It is recommended to call queryCameraFocalLengthCapability first to check the device's focal length capabilities, and then configure based on the query results.
Due to limitations on some Android devices, even if you set the focal length type according to the results returned in queryCameraFocalLengthCapability, the settings may not take effect.
Parameters
- config
- The camera capture configuration. See CameraCapturerConfiguration.Attention: In this method, you do not need to set the deviceId parameter.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
- < 0: Failure.
setCameraDeviceOrientation
Sets the rotation angle of the captured video.
Future<void> setCameraDeviceOrientation( {required VideoSourceType type, required VideoOrientation orientation});
Details
- This method applies to Windows only.
- You must call this method after enableVideo. The setting result will take effect after the camera is successfully turned on, that is, after the SDK triggers the onLocalVideoStateChanged callback and returns the local video state as localVideoStreamStateCapturing (1).
- When the video capture device does not have the gravity sensing function, you can call this method to manually adjust the rotation angle of the captured video.
Parameters
- type
- The video source type. See VideoSourceType.
- orientation
- The clockwise rotation angle. See VideoOrientation.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setCameraExposureFactor
Sets the camera exposure value.
Future<void> setCameraExposureFactor(double factor);
Details
Insufficient or excessive lighting in the shooting environment can affect the image quality of video capture. To achieve optimal video quality, you can use this method to adjust the camera's exposure value.
- This method is for Android and iOS only.
- You must call this method after enableVideo. The setting result will take effect after the camera is successfully turned on, that is, after the SDK triggers the onLocalVideoStateChanged callback and returns the local video state as localVideoStreamStateCapturing (1).
- Before calling this method, Agora recommends calling isCameraExposureSupported to check whether the current camera supports adjusting the exposure value.
- By calling this method, you adjust the exposure value of the currently active camera, that is, the camera specified when calling setCameraCapturerConfiguration.
Parameters
- factor
-
The camera exposure value. The default value is 0, which means using the default exposure of the camera. The larger the value, the greater the exposure. When the video image is overexposed, you can reduce the exposure value; when the video image is underexposed and the dark details are lost, you can increase the exposure value. If the exposure value you specified is beyond the range supported by the device, the SDK will automatically adjust it to the actual supported range of the device.
On Android, the value range is [-20.0, 20.0]. On iOS, the value range is [-8.0, 8.0].
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setCameraExposurePosition
Sets the camera exposure position.
Future<void> setCameraExposurePosition( {required double positionXinView, required double positionYinView});
Details
- This method is for Android and iOS only.
- You must call this method after enableVideo. The setting result will take effect after the camera is successfully turned on, that is, after the SDK triggers the onLocalVideoStateChanged callback and returns the local video state as localVideoStreamStateCapturing (1).
- After a successful method call, the SDK triggers the onCameraExposureAreaChanged callback.
Parameters
- positionXinView
- The horizontal coordinate of the touchpoint in the view.
- positionYinView
- The vertical coordinate of the touchpoint in the view.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setCameraFocusPositionInPreview
Sets the camera manual focus position.
Future<void> setCameraFocusPositionInPreview( {required double positionX, required double positionY});
Details
- This method is for Android and iOS only.
- You must call this method after enableVideo. The setting result will take effect after the camera is successfully turned on, that is, after the SDK triggers the onLocalVideoStateChanged callback and returns the local video state as localVideoStreamStateCapturing (1).
- After a successful method call, the SDK triggers the onCameraFocusAreaChanged callback.
Parameters
- positionX
- The horizontal coordinate of the touchpoint in the view.
- positionY
- The vertical coordinate of the touchpoint in the view.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setCameraStabilizationMode
Set the camera stabilization mode.
Future<void> setCameraStabilizationMode(CameraStabilizationMode mode);
This method applies to iOS only.
The camera stabilization mode is off by default. You need to call this method to turn it on and set the appropriate stabilization mode.
Applicable scenarios
When shooting on the move, in low light conditions, or with mobile devices, you can set the camera stabilization mode to reduce the impact of camera shake and get a more stable, clear picture.
Call timing
This method must be called after the camera is successfully enabled, that is, after the SDK triggers the onLocalVideoStateChanged callback and returns the local video state as localVideoStreamStateCapturing (1).
Restrictions
- Camera stabilization only works for scenarios with a video resolution greater than 1280 x 720.
- After enabling camera stabilization, the higher the camera stabilization level, the smaller the camera's field of view and the greater the camera's latency. To improve user experience, it is recommended that you set the mode parameter to cameraStabilizationModeLevel1.
Parameters
- mode
- Camera stabilization mode. See CameraStabilizationMode.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setCameraTorchOn
Enables the camera flash.
Future<void> setCameraTorchOn(bool isOn);
Details
- This method is for Android and iOS only.
- You must call this method after enableVideo. The setting result will take effect after the camera is successfully turned on, that is, after the SDK triggers the onLocalVideoStateChanged callback and returns the local video state as localVideoStreamStateCapturing (1).
Parameters
- isOn
-
Whether to turn on the camera flash:
true
: Turn on the flash.false
: (Default) Turn off the flash.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setCameraZoomFactor
Sets the camera zoom factor.
Future<void> setCameraZoomFactor(double factor);
Details
For iOS devices equipped with multi-lens rear cameras, such as those featuring dual-camera (wide-angle and ultra-wide-angle) or triple-camera (wide-angle, ultra-wide-angle, and telephoto), you can call setCameraCapturerConfiguration first to set the cameraFocalLengthType as cameraFocalLengthDefault (0) (standard lens). Then, adjust the camera zoom factor to a value less than 1.0. This configuration allows you to capture video with an ultra-wide-angle perspective.
- This method is for Android and iOS only.
- You must call this method after enableVideo. The setting result will take effect after the camera is successfully turned on, that is, after the SDK triggers the onLocalVideoStateChanged callback and returns the local video state as localVideoStreamStateCapturing (1).
Parameters
- factor
- The camera zoom factor. For devices that do not support ultra-wide-angle, the value ranges from 1.0 to the maximum zoom factor; for devices that support ultra-wide-angle, the value ranges from 0.5 to the maximum zoom factor. You can get the maximum zoom factor supported by the device by calling the getCameraMaxZoomFactor method.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
- < 0: if the method if failed.
setChannelProfile
Sets the channel profile.
Future<void> setChannelProfile(ChannelProfileType profile);
You can call this method to set the channel profile. The SDK adopts different optimization strategies for different channel profiles. For example, in a live streaming scenario, the SDK prioritizes video quality. After initializing the SDK, the default channel profile is the live streaming profile.
Call timing
Call this method before joining a channel.
Restrictions
To ensure the quality of real-time communication, Agora recommends that all users in a channel use the same channel profile.
Parameters
- profile
-
The channel profile. See ChannelProfileType.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
- < 0: Failure.
- -2: The parameter is invalid.
- -7: The SDK is not initialized.
setCloudProxy
Sets up cloud proxy service.
Future<void> setCloudProxy(CloudProxyType proxyType);
Details
When users' network access is restricted by a firewall, configure the firewall to allow specific IP addresses and ports provided by Agora; then, call this method to enable the cloud proxyType and set the cloud proxy type with the proxyType parameter.
After successfully connecting to the cloud proxy, the SDK triggers the onConnectionStateChanged (connectionStateConnecting, connectionChangedSettingProxyServer) callback.
To disable the cloud proxy that has been set, call the setCloudProxy(noneProxy)
.
To change the cloud proxy type that has been set, call the setCloudProxy(noneProxy)
first, and then call the setCloudProxy to set the proxyType you want.
- Agora recommends that you call this method before joining a channel.
- When a user is behind a firewall and uses the Force UDP cloud proxy, the services for Media Push and cohosting across channels are not available.
- When you use the Force TCP cloud proxy, note that an error would occur when calling the startAudioMixing method to play online music files in the HTTP protocol. The services for Media Push and cohosting across channels use the cloud proxy with the TCP protocol.
Parameters
- proxyType
-
The type of the cloud proxy. See CloudProxyType.
This parameter is mandatory. The SDK reports an error if you do not pass in a value.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setClientRole
Set the user role and the audience latency level in a live streaming scenario.
Future<void> setClientRole( {required ClientRoleType role, ClientRoleOptions? options});
By default,the SDK sets the user role as audience. You can call this method to set the user role as host. The user role (roles) determines the users' permissions at the SDK level, including whether they can publish audio and video streams in a channel.
Call timing
You can call this method either before or after joining a channel.
If you call this method to set the user role as the host before joining the channel and set the local video property through the setupLocalVideo method, the local video preview is automatically enabled when the user joins the channel.
If you call this method to set the user role after joining a channel, the SDK will automatically call the muteLocalAudioStream and muteLocalVideoStream method to change the state for publishing audio and video streams.
Restrictions
When the user role is set to host, the audience latency level can only be set to audienceLatencyLevelUltraLowLatency.
When calling this method before joining a channel and setting the role to BROADCASTER, the onClientRoleChanged callback will not be triggered on the local client.
Parameters
- role
- The user role. See ClientRoleType.
Note: If you set the user role as an audience member, you cannot publish audio and video streams in the channel. If you want to publish media streams in a channel during live streaming, ensure you set the user role as broadcaster.
- options
- The detailed options of a user, including the user level. See ClientRoleOptions.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setColorEnhanceOptions
Sets color enhancement.
Future<void> setColorEnhanceOptions( {required bool enabled, required ColorEnhanceOptions options, MediaSourceType type = MediaSourceType.primaryCameraSource});
Details
The video images captured by the camera can have color distortion. The color enhancement feature intelligently adjusts video characteristics such as saturation and contrast to enhance the video color richness and color reproduction, making the video more vivid.
You can call this method to enable the color enhancement feature and set the options of the color enhancement effect.
- Call this method after calling enableVideo.
- The color enhancement feature has certain performance requirements on devices. With color enhancement turned on, Agora recommends that you change the color enhancement level to one that consumes less performance or turn off color enhancement if your device is experiencing severe heat problems.
- This method relies on the image enhancement dynamic library
libagora_clear_vision_extension.dll
. If the dynamic library is deleted, the function cannot be enabled normally.
Parameters
- enabled
- Whether to enable color enhancement:
true
Enable color enhancement.false
: (Default) Disable color enhancement.
- options
- The color enhancement options. See ColorEnhanceOptions.
- type
- The type of the media source to which the filter effect is applied. See MediaSourceType.Attention: In this method, this parameter supports only the following two settings:
- Use the default value primaryCameraSource if you use camera to capture local video.
- Set this parameter to customVideoSource if you use custom video source.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setDefaultAudioRouteToSpeakerphone
Sets the default audio playback route.
Future<void> setDefaultAudioRouteToSpeakerphone(bool defaultToSpeaker);
Most mobile phones have two audio routes: an earpiece at the top, and a speakerphone at the bottom. The earpiece plays at a lower volume, and the speakerphone at a higher volume. When setting the default audio route, you determine whether audio playback comes through the earpiece or speakerphone when no external audio device is connected.
- Voice call: Earpiece.
- Audio broadcast: Speakerphone.
- Video call: Speakerphone.
- Video broadcast: Speakerphone.
You can call this method to change the default audio route.
After calling this method to set the default audio route, the actual audio route of the system will change with the connection of external audio devices (wired headphones or Bluetooth headphones). See .
Call timing
Call this method before joining a channel. If you need to change the audio route after joining a channel, call setEnableSpeakerphone.
Restrictions
None.
Parameters
- defaultToSpeaker
- Whether to set the speakerphone as the default audio route:
true
: Set the speakerphone as the default audio route.false
: Set the earpiece as the default audio route.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setDirectCdnStreamingAudioConfiguration
Sets the audio profile of the audio streams directly pushed to the CDN by the host.
Future<void> setDirectCdnStreamingAudioConfiguration( AudioProfileType profile);
When you set the publishMicrophoneTrack or publishCustomAudioTrack in the DirectCdnStreamingMediaOptions as true
to capture audios, you can call this method to set the audio profile.
Parameters
- profile
-
The audio profile, including the sampling rate, bitrate, encoding mode, and the number of channels. See AudioProfileType.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setDirectCdnStreamingVideoConfiguration
Sets the video profile of the media streams directly pushed to the CDN by the host.
Future<void> setDirectCdnStreamingVideoConfiguration( VideoEncoderConfiguration config);
Details
This method only affects video streams captured by cameras or screens, or from custom video capture sources. That is, when you set publishCameraTrack or publishCustomVideoTrack in DirectCdnStreamingMediaOptions as true
to capture videos, you can call this method to set the video profiles.
If your local camera does not support the video resolution you set,the SDK automatically adjusts the video resolution to a value that is closest to your settings for capture, encoding or streaming, with the same aspect ratio as the resolution you set. You can get the actual resolution of the video streams through the onDirectCdnStreamingStats callback.
Parameters
- config
- Video profile. See VideoEncoderConfiguration.Note: During CDN live streaming, Agora only supports setting OrientationMode as orientationModeFixedLandscape or orientationModeFixedPortrait.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setDualStreamMode
Sets dual-stream mode configuration on the sender side.
Future<void> setDualStreamMode( {required SimulcastStreamMode mode, SimulcastStreamConfig? streamConfig});
Details
- If you want to modify this behavior, you can call this method and set mode to disableSimulcastStream (never send low-quality video streams) or enableSimulcastStream (always send low-quality video streams).
- If you want to restore the default behavior after making changes, you can call this method again with mode set to autoSimulcastStream.
- When calling this method and setting mode to disableSimulcastStream, it has the same effect as calling enableDualStreamMode and setting enabled to
false
. - When calling this method and setting mode to enableSimulcastStream, it has the same effect as calling enableDualStreamMode and setting enabled to
true
. - Both methods can be called before and after joining a channel. If both methods are used, the settings in the method called later takes precedence.
Parameters
- mode
- The mode in which the video stream is sent. See SimulcastStreamMode.
- streamConfig
-
The configuration of the low-quality video stream. See SimulcastStreamConfig.Note: When setting mode to disableSimulcastStream, setting streamConfig will not take effect.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setEarMonitoringAudioFrameParameters
Sets the format of the in-ear monitoring raw audio data.
Future<void> setEarMonitoringAudioFrameParameters( {required int sampleRate, required int channel, required RawAudioFrameOpModeType mode, required int samplesPerCall});
Details
This method is used to set the in-ear monitoring audio data format reported by the onEarMonitoringAudioFrame callback.
- Before calling this method, you need to call enableInEarMonitoring, and set includeAudioFilters to earMonitoringFilterBuiltInAudioFilters or earMonitoringFilterNoiseSuppression.
- The SDK calculates the sampling interval based on the samplesPerCall, sampleRate and channel parameters set in this method.Sample interval (sec) = samplePerCall/(sampleRate × channel). Ensure that the sample interval ≥ 0.01 (s). The SDK triggers the onEarMonitoringAudioFrame callback according to the sampling interval.
Parameters
- sampleRate
- The sample rate of the audio data reported in the onEarMonitoringAudioFrame callback, which can be set as 8,000, 16,000, 32,000, 44,100, or 48,000 Hz.
- channel
-
The number of audio channels reported in the onEarMonitoringAudioFrame callback.
- 1: Mono.
- 2: Stereo.
- mode
-
The use mode of the audio frame. See RawAudioFrameOpModeType.
- samplesPerCall
- The number of data samples reported in the onEarMonitoringAudioFrame callback, such as 1,024 for the Media Push.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
- < 0: Failure.
setEffectPosition
Sets the playback position of an audio effect file.
Future<void> setEffectPosition({required int soundId, required int pos});
Details
After a successful setting, the local audio effect file starts playing at the specified position.
Parameters
- soundId
- The audio effect ID. The ID of each audio effect file is unique.
- pos
- The playback position (ms) of the audio effect file.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setEffectsVolume
Sets the volume of the audio effects.
Future<void> setEffectsVolume(int volume);
Call timing
Call this method after playEffect.
Restrictions
None.
Parameters
- volume
- The playback volume. The value range is [0, 100]. The default value is 100, which represents the original volume.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setEnableSpeakerphone
Enables/Disables the audio route to the speakerphone.
Future<void> setEnableSpeakerphone(bool speakerOn);
For the default audio route in different scenarios, see .
Applicable scenarios
If the default audio route of the SDK or the setting in setDefaultAudioRouteToSpeakerphone cannot meet your requirements, you can call this method to switch the current audio route.
Call timing
Call this method after joining a channel.
Restrictions
- This method only sets the audio route in the current channel and does not influence the default audio route. If the user leaves the current channel and joins another channel, the default audio route is used.
- If the user uses an external audio playback device such as a Bluetooth or wired headset, this method does not take effect, and the SDK plays audio through the external device. When the user uses multiple external devices, the SDK plays audio through the last connected device.
Parameters
- speakerOn
-
Sets whether to enable the speakerphone or earpiece:
true
: Enable device state monitoring. The audio route is the speakerphone.false
: Disable device state monitoring. The audio route is the earpiece.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setExtensionProperty
Sets the properties of the extension.
Future<void> setExtensionProperty( {required String provider, required String extension, required String key, required String value, MediaSourceType type = MediaSourceType.unknownMediaSource});
After enabling the extension, you can call this method to set the properties of the extension.
Call timing
Call this mehtod after calling enableExtension.
Restrictions
If you want to set properties for multiple extensions, you need to call this method multiple times.
Parameters
- provider
- The name of the extension provider.
- extension
- The name of the extension.
- key
- The key of the extension.
- value
- The value of the extension key.
- type
- Source type of the extension. See MediaSourceType.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setExtensionProviderProperty
Sets the properties of the extension provider.
Future<void> setExtensionProviderProperty( {required String provider, required String key, required String value});
You can call this method to set the attributes of the extension provider and initialize the relevant parameters according to the type of the provider.
Call timing
Call this method before enableExtension and after registerExtension.
Restrictions
If you want to set the properties of the extension provider for multiple extensions, you need to call this method multiple times.
Parameters
- provider
- The name of the extension provider.
- key
- The key of the extension.
- value
- The value of the extension key.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setExternalMediaProjection
Configures MediaProjection
outside of the SDK to capture screen video streams.
Future<void> setExternalMediaProjection(int mediaProjection);
After successfully calling this method, the external MediaProjection
you set will replace the MediaProjection
requested by the SDK to capture the screen video stream.
When the screen sharing is stopped or RtcEngine is destroyed, the SDK will automatically release the MediaProjection.
Applicable scenarios
MediaProjection
, you can directly use your MediaProjection
instead of the one applied for by the SDK. The following lists two applicable scenarios:
- On custom system devices, it can avoid system pop-ups (such as requiring user permission to capture the screen) and directly start capturing the screen video stream.
- In a screen sharing process that involves one or more sub-processes, it can help avoid errors that might occur when creating objects within these sub-processes, which could otherwise lead to failures in screen capturing.
Call timing
Call this method after startScreenCapture.
Restrictions
Before calling this method, you must first apply for MediaProjection
permission.
Parameters
- mediaProjection
- An object used to capture screen video streams.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setExternalRemoteEglContext
Sets the EGL context for rendering remote video streams.
Future<void> setExternalRemoteEglContext(int eglContext);
This method can replace the default remote EGL context within the SDK, making it easier to manage the EGL context.
When the engine is destroyed, the SDK will automatically release the EGL context.
Applicable scenarios
This method is suitable for using a custom video rendering method instead of the default SDK rendering method to render remote video frames in Texture format.
Call timing
Call this method before joining a channel.
Restrictions
None.
Parameters
- eglContext
- The EGL context for rendering remote video streams.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setFilterEffectOptions
Sets the filter effect options and specifies the media source.
Future<void> setFilterEffectOptions( {required bool enabled, required FilterEffectOptions options, MediaSourceType type = MediaSourceType.primaryCameraSource});
Call timing
Call this method after calling enableVideo.
Restrictions
- This method relies on the image enhancement dynamic library
libagora_clear_vision_extension.dll
. If the dynamic library is deleted, the function cannot be enabled normally. - This feature has high requirements on device performance. When calling this method, the SDK automatically checks the capabilities of the current device.
Parameters
- enabled
- Whether to enable the filter effect:
true
: Yes.false
: (Default) No.
- options
- The filter effect options. See FilterEffectOptions.
- type
- The type of the media source to which the filter effect is applied. See MediaSourceType.Attention: In this method, this parameter supports only the following two settings:
- Use the default value primaryCameraSource if you use camera to capture local video.
- Set this parameter to customVideoSource if you use custom video source.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setHeadphoneEQParameters
Sets the low- and high-frequency parameters of the headphone equalizer.
Future<void> setHeadphoneEQParameters( {required int lowGain, required int highGain});
Details
In a spatial audio effect scenario, if the preset headphone equalization effect is not achieved after calling the setHeadphoneEQPreset method, you can further adjust the headphone equalization effect by calling this method.
Parameters
- lowGain
- The low-frequency parameters of the headphone equalizer. The value range is [-10,10]. The larger the value, the deeper the sound.
- highGain
- The high-frequency parameters of the headphone equalizer. The value range is [-10,10]. The larger the value, the sharper the sound.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setHeadphoneEQPreset
Sets the preset headphone equalization effect.
Future<void> setHeadphoneEQPreset(HeadphoneEqualizerPreset preset);
Details
This method is mainly used in spatial audio effect scenarios. You can select the preset headphone equalizer to listen to the audio to achieve the expected audio experience.
Parameters
- preset
- The preset headphone equalization effect. See HeadphoneEqualizerPreset.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setInEarMonitoringVolume
Sets the volume of the in-ear monitor.
Future<void> setInEarMonitoringVolume(int volume);
Call timing
This method can be called either before or after joining the channel.
Restrictions
None.
Parameters
- volume
-
The volume of the user. The value range is [0,400].
- 0: Mute.
- 100: (Default) The original volume.
- 400: Four times the original volume (amplifying the audio signals by four times).
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setLocalRenderMode
Updates the display mode of the local video view.
Future<void> setLocalRenderMode( {required RenderModeType renderMode, VideoMirrorModeType mirrorMode = VideoMirrorModeType.videoMirrorModeAuto});
After initializing the local video view, you can call this method to update its rendering and mirror modes. It affects only the video view that the local user sees and does not impact the publishing of the local video.
Call timing
- Ensure that you have called the setupLocalVideo method to initialize the local video view before calling this method.
- During a call, you can call this method as many times as necessary to update the display mode of the local video view.
Restrictions
This method only takes effect on the primary camera (primaryCameraSource)
. In scenarios involving custom video capture or the use of alternative video sources, you need to use setupLocalVideo instead of this method.
Parameters
- renderMode
-
The local video display mode. See RenderModeType.
- mirrorMode
-
The mirror mode of the local video view. See VideoMirrorModeType.
Attention: If you use a front camera, the SDK enables the mirror mode by default; if you use a rear camera, the SDK disables the mirror mode by default.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setLocalRenderTargetFps
Sets the maximum frame rate for rendering local video.
Future<void> setLocalRenderTargetFps( {required VideoSourceType sourceType, required int targetFps});
Applicable scenarios
In scenarios where the requirements for video rendering frame rate are not high (such as screen sharing or online education), you can call this method to set the maximum frame rate for local video rendering. The SDK will attempt to keep the actual frame rate of local rendering close to this value, which helps to reduce CPU consumption and improving system performance.
Call timing
You can call this method either before or after joining a channel.
Restrictions
None.
Parameters
- sourceType
- The type of the video source. See VideoSourceType.
- targetFps
- The capture frame rate (fps) of the local video. Sopported values are: 1, 7, 10, 15, 24, 30, 60.CAUTION: Set this parameter to a value lower than the actual video frame rate; otherwise, the settings do not take effect.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setLocalVideoMirrorMode
Sets the local video mirror mode.
Future<void> setLocalVideoMirrorMode(VideoMirrorModeType mirrorMode);
Details
- Deprecated:
- This method is deprecated.
Parameters
- mirrorMode
-
The local video mirror mode. See VideoMirrorModeType.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setLocalVoiceEqualization
Sets the local voice equalization effect.
Future<void> setLocalVoiceEqualization( {required AudioEqualizationBandFrequency bandFrequency, required int bandGain});
Call timing
This method can be called either before or after joining the channel.
Restrictions
None.
Parameters
- bandFrequency
- The band frequency. The value ranges between 0 and 9; representing the respective 10-band center frequencies of the voice effects, including 31, 62, 125, 250, 500, 1k, 2k, 4k, 8k, and 16k Hz. See AudioEqualizationBandFrequency.
- bandGain
- The gain of each band in dB. The value ranges between -15 and 15. The default value is 0.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setLocalVoiceFormant
Set the formant ratio to change the timbre of human voice.
Future<void> setLocalVoiceFormant(double formantRatio);
Formant ratio affects the timbre of voice. The smaller the value, the deeper the sound will be, and the larger, the sharper. After you set the formant ratio, all users in the channel can hear the changed voice. If you want to change the timbre and pitch of voice at the same time, Agora recommends using this method together with setLocalVoicePitch.
Applicable scenarios
You can call this method to set the formant ratio of local audio to change the timbre of human voice.
Call timing
This method can be called either before or after joining the channel.
Restrictions
None.
Parameters
- formantRatio
- The formant ratio. The value range is [-1.0, 1.0]. The default value is 0.0, which means do not change the timbre of the voice.Note: Agora recommends setting this value within the range of [-0.4, 0.6]. Otherwise, the voice may be seriously distorted.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setLocalVoicePitch
Changes the voice pitch of the local speaker.
Future<void> setLocalVoicePitch(double pitch);
Call timing
This method can be called either before or after joining the channel.
Restrictions
None.
Parameters
- pitch
- The local voice pitch. The value range is [0.5,2.0]. The lower the value, the lower the pitch. The default value is 1.0 (no change to the pitch).
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setLocalVoiceReverb
Sets the local voice reverberation.
Future<void> setLocalVoiceReverb( {required AudioReverbType reverbKey, required int value});
Details
The SDK provides an easier-to-use method, setAudioEffectPreset, to directly implement preset reverb effects for such as pop, R&B, and KTV.
Parameters
- reverbKey
- The reverberation key. Agora provides five reverberation keys, see AudioReverbType.
- value
- The value of the reverberation key.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setLogFile
Sets the log file.
Future<void> setLogFile(String filePath);
- Deprecated:
- This method is deprecated. Set the log file path by configuring the context parameter when calling initialize.
Specifies an SDK output log file. The log file records all log data for the SDK’s operation.
Call timing
This method needs to be called immediately after initialize, otherwise the output log may be incomplete.
Restrictions
Ensure that the directory for the log file exists and is writable.
Parameters
- filePath
- The complete path of the log files. These log files are encoded in UTF-8.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setLogFileSize
Sets the log file size.
Future<void> setLogFileSize(int fileSizeInKBytes);
Details
- Deprecated:
- Use the
logConfig
parameter in initialize instead.
By default, the SDK generates five SDK log files and five API call log files with the following rules:
- The SDK log files are:
agorasdk.log
,agorasdk.1.log
,agorasdk.2.log
,agorasdk.3.log
, andagorasdk.4.log
. - The API call log files are:
agoraapi.log
,agoraapi.1.log
,agoraapi.2.log
,agoraapi.3.log
, andagoraapi.4.log
. - The default size of each SDK log file and API log file is 2,048 KB. These log files are encoded in UTF-8.
- The SDK writes the latest logs in
agorasdk.log
oragoraapi.log
. - When
agorasdk.log
is full, the SDK processes the log files in the following order:- Delete the
agorasdk.4.log
file (if any). - Rename
agorasdk.3.log
toagorasdk.4.log
. - Rename
agorasdk.2.log
toagorasdk.3.log
. - Rename
agorasdk.1.log
toagorasdk.2.log
. - Create a new
agorasdk.log
file.
- Delete the
- The overwrite rules for the
agoraapi.log
file are the same as foragorasdk.log
.
This method is used to set the size of the agorasdk.log
file only and does not effect the agoraapi.log file
.
Parameters
- fileSizeInKBytes
- The size (KB) of an
agorasdk.log
file. The value range is [128,20480]. The default value is 2,048 KB. If you setfileSizeInKByte
smaller than 128 KB, the SDK automatically adjusts it to 128 KB; if you setfileSizeInKByte
greater than 20,480 KB, the SDK automatically adjusts it to 20,480 KB.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setLogFilter
Sets the log output level of the SDK.
Future<void> setLogFilter(LogFilterType filter);
Details
- Deprecated:
- Use logConfig in initialize instead.
This method sets the output log level of the SDK. You can use one or a combination of the log filter levels. The log level follows the sequence of logFilterOff, logFilterCritical, logFilterError, logFilterWarn, logFilterInfo, and logFilterDebug. Choose a level to see the logs preceding that level.
If, for example, you set the log level to logFilterWarn, you see the logs within levels logFilterCritical, logFilterError and logFilterWarn.
Parameters
- filter
-
The output log level of the SDK. See LogFilterType.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setLogLevel
Sets the output log level of the SDK.
Future<void> setLogLevel(LogLevel level);
- Deprecated:
- This method is deprecated. Set the log file level by configuring the context parameter when calling initialize.
Choose a level to see the logs preceding that level.
Parameters
- level
- The log level. See LogLevel.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setLowlightEnhanceOptions
Sets low-light enhancement.
Future<void> setLowlightEnhanceOptions( {required bool enabled, required LowlightEnhanceOptions options, MediaSourceType type = MediaSourceType.primaryCameraSource});
You can call this method to enable the color enhancement feature and set the options of the color enhancement effect.
Applicable scenarios
The low-light enhancement feature can adaptively adjust the brightness value of the video captured in situations with low or uneven lighting, such as backlit, cloudy, or dark scenes. It restores or highlights the image details and improves the overall visual effect of the video.
Call timing
Call this method after calling enableVideo.
Restrictions
- This method relies on the image enhancement dynamic library
libagora_clear_vision_extension.dll
. If the dynamic library is deleted, the function cannot be enabled normally. - Dark light enhancement has certain requirements for equipment performance. The low-light enhancement feature has certain performance requirements on devices. If your device overheats after you enable low-light enhancement, Agora recommends modifying the low-light enhancement options to a less performance-consuming level or disabling low-light enhancement entirely.
- If you want to prioritize image quality (lowLightEnhanceLevelHighQuality) when using the low-light enhancement function, you need to first call setVideoDenoiserOptions to achieve video noise reduction, the specific corresponding relationship is as follows:
- When low light enhancement is set to automatic mode (LowLightEnhanceAuto), video noise reduction needs to be set to prioritize image quality (videoDenoiserLevelHighQuality) and automatic mode (videoDenoiserAuto).
- When low-light enhancement is set to manual mode (LowLightEnhanceManual), video noise reduction needs to be set to prioritize image quality (videoDenoiserLevelHighQuality) and manual mode (videoDenoiserManual).
Parameters
- enabled
- Whether to enable low-light enhancement:
true
: Enable low-light enhancement.false
: (Default) Disable low-light enhancement.
- options
- The low-light enhancement options. See LowlightEnhanceOptions.
- type
- The type of the media source to which the filter effect is applied. See MediaSourceType.Attention: In this method, this parameter supports only the following two settings:
- Use the default value primaryCameraSource if you use camera to capture local video.
- Set this parameter to customVideoSource if you use custom video source.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setMaxMetadataSize
Sets the maximum size of the media metadata.
Future<void> setMaxMetadataSize(int size);
Details
After calling registerMediaMetadataObserver, you can call this method to set the maximum size of the media metadata.
Parameters
- size
- The maximum size of media metadata.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
- < 0: Failure.
setMixedAudioFrameParameters
Set the format of the raw audio data after mixing for audio capture and playback.
Future<void> setMixedAudioFrameParameters( {required int sampleRate, required int channel, required int samplesPerCall});
The SDK calculates the sampling interval based on the samplesPerCall, sampleRate and channel parameters set in this method.Sample interval (sec) = samplePerCall/(sampleRate × channel). Ensure that the sample interval ≥ 0.01 (s). The SDK triggers the onMixedAudioFrame callback according to the sampling interval.
Call timing
Call this method before joining a channel.
Restrictions
None.
Parameters
- sampleRate
- The sample rate returned in the callback, which can be set as 8000, 16000, 32000, 44100, or 48000 Hz.
- channel
- The number of audio channels. You can set the value as 1 or 2.
- 1: Mono.
- 2: Stereo.
- samplesPerCall
- The number of data samples, such as 1024 for the Media Push.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setParameters
Provides technical preview functionalities or special customizations by configuring the SDK with JSON options.
Future<void> setParameters(String parameters);
Parameters
- parameters
- Pointer to the set parameters in a JSON string.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setPlaybackAudioFrameBeforeMixingParameters
Sets the format of the raw audio playback data before mixing.
Future<void> setPlaybackAudioFrameBeforeMixingParameters( {required int sampleRate, required int channel});
The SDK triggers the onPlaybackAudioFrameBeforeMixing callback according to the sampling interval.
Call timing
Call this method before joining a channel.
Restrictions
None.
Parameters
- sampleRate
- The sample rate returned in the callback, which can be set as 8000, 16000, 32000, 44100, or 48000 Hz.
- channel
- The number of audio channels. You can set the value as 1 or 2.
- 1: Mono.
- 2: Stereo.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setPlaybackAudioFrameParameters
Sets the format of the raw audio playback data.
Future<void> setPlaybackAudioFrameParameters( {required int sampleRate, required int channel, required RawAudioFrameOpModeType mode, required int samplesPerCall});
The SDK calculates the sampling interval based on the samplesPerCall, sampleRate and channel parameters set in this method.Sample interval (sec) = samplePerCall/(sampleRate × channel). Ensure that the sample interval ≥ 0.01 (s). The SDK triggers the onPlaybackAudioFrame callback according to the sampling interval.
Call timing
Call this method before joining a channel.
Restrictions
None.
Parameters
- sampleRate
- The sample rate returned in the callback, which can be set as 8000, 16000, 32000, 44100, or 48000 Hz.
- channel
- The number of audio channels. You can set the value as 1 or 2.
- 1: Mono.
- 2: Stereo.
- mode
-
The use mode of the audio frame. See RawAudioFrameOpModeType.
- samplesPerCall
- The number of data samples, such as 1024 for the Media Push.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
- < 0: Failure.
setRecordingAudioFrameParameters
Sets the format of the captured raw audio data.
Future<void> setRecordingAudioFrameParameters( {required int sampleRate, required int channel, required RawAudioFrameOpModeType mode, required int samplesPerCall});
The SDK calculates the sampling interval based on the samplesPerCall, sampleRate and channel parameters set in this method.Sample interval (sec) = samplePerCall/(sampleRate × channel). Ensure that the sample interval ≥ 0.01 (s). The SDK triggers the onRecordAudioFrame callback according to the sampling interval.
Call timing
Call this method before joining a channel.
Restrictions
None.
Parameters
- sampleRate
- The sample rate returned in the callback, which can be set as 8000, 16000, 32000, 44100, or 48000 Hz.
- channel
- The number of audio channels. You can set the value as 1 or 2.
- 1: Mono.
- 2: Stereo.
- mode
-
The use mode of the audio frame. See RawAudioFrameOpModeType.
- samplesPerCall
- The number of data samples, such as 1024 for the Media Push.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
- < 0: Failure.
setRemoteDefaultVideoStreamType
Sets the default video stream type to subscribe to.
Future<void> setRemoteDefaultVideoStreamType(VideoStreamType streamType);
- The SDK enables low-quality video stream adaptive mode (autoSimulcastStream) on the sender side by default, meaning only the high-quality video stream is transmitted. Only the receiver with the role of the host can call this method to initiate a low-quality video stream request. Once the sender receives the request, it starts automatically sending the low-quality video stream. At this point, all users in the channel can call this method to switch to low-quality video stream subscription mode.
- If the sender calls setDualStreamMode and sets mode to disableSimulcastStream (never send low-quality video stream), then calling this method will have no effect.
- If the sender calls setDualStreamMode and sets mode to enableSimulcastStream (always send low-quality video stream), both the host and audience receivers can call this method to switch to low-quality video stream subscription mode.
The SDK will dynamically adjust the size of the corresponding video stream based on the size of the video window to save bandwidth and computing resources. The default aspect ratio of the low-quality video stream is the same as that of the high-quality video stream. According to the current aspect ratio of the high-quality video stream, the system will automatically allocate the resolution, frame rate, and bitrate of the low-quality video stream.
Call timing
Call this method before joining a channel. The SDK does not support changing the default subscribed video stream type after joining a channel.
Restrictions
If you call both this method and setRemoteVideoStreamType, the setting of setRemoteVideoStreamType takes effect.
Parameters
- streamType
-
The default video-stream type. See VideoStreamType.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setRemoteRenderMode
Updates the display mode of the video view of a remote user.
Future<void> setRemoteRenderMode( {required int uid, required RenderModeType renderMode, required VideoMirrorModeType mirrorMode});
Details
After initializing the video view of a remote user, you can call this method to update its rendering and mirror modes. This method affects only the video view that the local user sees.
- Call this method after initializing the remote view by calling the setupRemoteVideo method.
- During a call, you can call this method as many times as necessary to update the display mode of the video view of a remote user.
Parameters
- uid
- The user ID of the remote user.
- renderMode
-
The rendering mode of the remote user view. For details, see RenderModeType.
- mirrorMode
-
The mirror mode of the remote user view. See VideoMirrorModeType.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
- < 0: Failure.
setRemoteRenderTargetFps
Sets the maximum frame rate for rendering remote video.
Future<void> setRemoteRenderTargetFps(int targetFps);
Applicable scenarios
In scenarios where the video rendering frame rate is not critical (e.g., screen sharing, online education) or when the remote users are using mid-to-low-end devices, you can call this method to set the maximum frame rate for video rendering on the remote client. The SDK will attempt to render the actual frame rate as close as possible to this value, which helps to reduce CPU consumption and improve system performance.
Call timing
You can call this method either before or after joining a channel.
Restrictions
None.
Parameters
- targetFps
- The capture frame rate (fps) of the local video. Sopported values are: 1, 7, 10, 15, 24, 30, 60.CAUTION: Set this parameter to a value lower than the actual video frame rate; otherwise, the settings do not take effect.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setRemoteUserSpatialAudioParams
Sets the spatial audio effect parameters of the remote user.
Future<void> setRemoteUserSpatialAudioParams( {required int uid, required SpatialAudioParams params});
Details
Call this method after enableSpatialAudio. After successfully setting the spatial audio effect parameters of the remote user, the local user can hear the remote user with a sense of space.
Parameters
- uid
- The user ID. This parameter must be the same as the user ID passed in when the user joined the channel.
- params
- The spatial audio parameters. See SpatialAudioParams.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setRemoteVideoStreamType
Sets the video stream type to subscribe to.
Future<void> setRemoteVideoStreamType( {required int uid, required VideoStreamType streamType});
Details
- The SDK enables low-quality video stream adaptive mode (autoSimulcastStream) on the sender side by default, meaning only the high-quality video stream is transmitted. Only the receiver with the role of the host can call this method to initiate a low-quality video stream request. Once the sender receives the request, it starts automatically sending the low-quality video stream. At this point, all users in the channel can call this method to switch to low-quality video stream subscription mode.
- If the sender calls setDualStreamMode and sets mode to disableSimulcastStream (never send low-quality video stream), then calling this method will have no effect.
- If the sender calls setDualStreamMode and sets mode to enableSimulcastStream (always send low-quality video stream), both the host and audience receivers can call this method to switch to low-quality video stream subscription mode.
The SDK will dynamically adjust the size of the corresponding video stream based on the size of the video window to save bandwidth and computing resources. The default aspect ratio of the low-quality video stream is the same as that of the high-quality video stream. According to the current aspect ratio of the high-quality video stream, the system will automatically allocate the resolution, frame rate, and bitrate of the low-quality video stream.
- You can call this method either before or after joining a channel.
- If you call both this method and setRemoteDefaultVideoStreamType, the setting of this method takes effect.
Parameters
- uid
- The user ID.
- streamType
-
The video stream type, see VideoStreamType.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setRemoteVideoSubscriptionOptions
Options for subscribing to remote video streams.
Future<void> setRemoteVideoSubscriptionOptions( {required int uid, required VideoSubscriptionOptions options});
Details
- If the VideoFrameObserver observer is registered, the default is to subscribe to both raw data and encoded data.
- If the VideoEncodedFrameObserver observer is registered, the default is to subscribe only to the encoded data.
- If both types of observers are registered, the default behavior follows the last registered video observer. For example, if the last registered observer is the VideoFrameObserver observer, the default is to subscribe to both raw data and encoded data.
uids
, you can call this method to set it. Parameters
- uid
- The user ID of the remote user.
- options
- The video subscription options. See VideoSubscriptionOptions.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setRemoteVoicePosition
Sets the 2D position (the position on the horizontal plane) of the remote user's voice.
Future<void> setRemoteVoicePosition( {required int uid, required double pan, required double gain});
Details
This method sets the 2D position and volume of a remote user, so that the local user can easily hear and identify the remote user's position.
When the local user calls this method to set the voice position of a remote user, the voice difference between the left and right channels allows the local user to track the real-time position of the remote user, creating a sense of space. This method applies to massive multiplayer online games, such as Battle Royale games.
- For this method to work, enable stereo panning for remote users by calling the enableSoundPositionIndication method before joining a channel.
- For the best voice positioning, Agora recommends using a wired headset.
- Call this method after joining a channel.
Parameters
- uid
- The user ID of the remote user.
- pan
- The voice position of the remote user. The value ranges from -1.0 to 1.0:
- 0.0: (Default) The remote voice comes from the front.
- -1.0: The remote voice comes from the left.
- 1.0: The remote voice comes from the right.
- gain
- The volume of the remote user. The value ranges from 0.0 to 100.0. The default value is 100.0 (the original volume of the remote user). The smaller the value, the lower the volume.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setRouteInCommunicationMode
Selects the audio playback route in communication audio mode.
Future<void> setRouteInCommunicationMode(int route);
This method is used to switch the audio route from Bluetooth headphones to earpiece, wired headphones or speakers in communication audio mode ().
Call timing
This method can be called either before or after joining the channel.
Restrictions
Using this method and the setEnableSpeakerphone method at the same time may cause conflicts. Agora recommends that you use the setRouteInCommunicationMode method alone.
Parameters
- route
- The audio playback route you want to use:
- -1: The default audio route.
- 0: Headphones with microphone.
- 1: Handset.
- 2: Headphones without microphone.
- 3: Device's built-in speaker.
- 4: (Not supported yet) External speakers.
- 5: Bluetooth headphones.
- 6: USB device.
Exceptions
Without practical meaning.
setScreenCaptureContentHint
Sets the content hint for screen sharing.
Future<void> setScreenCaptureContentHint(VideoContentHint contentHint);
Details
A content hint suggests the type of the content being shared, so that the SDK applies different optimization algorithms to different types of content. If you don't call this method, the default content hint is contentHintNone.
Parameters
- contentHint
- The content hint for screen sharing. See VideoContentHint.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setScreenCaptureScenario
Sets the screen sharing scenario.
Future<void> setScreenCaptureScenario(ScreenScenarioType screenScenario);
Details
When you start screen sharing or window sharing, you can call this method to set the screen sharing scenario. The SDK adjusts the video quality and experience of the sharing according to the scenario.
Parameters
- screenScenario
- The screen sharing scenario. See ScreenScenarioType.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setSubscribeAudioBlocklist
Set the blocklist of subscriptions for audio streams.
Future<void> setSubscribeAudioBlocklist( {required List<int> uidList, required int uidNumber});
Details
You can call this method to specify the audio streams of a user that you do not want to subscribe to.
- You can call this method either before or after joining a channel.
- The blocklist is not affected by the setting in muteRemoteAudioStream,muteAllRemoteAudioStreams, and autoSubscribeAudio in ChannelMediaOptions.
- Once the blocklist of subscriptions is set, it is effective even if you leave the current channel and rejoin the channel.
- If a user is added in the allowlist and blocklist at the same time, only the blocklist takes effect.
Parameters
- uidList
-
The user ID list of users that you do not want to subscribe to.
If you want to specify the audio streams of a user that you do not want to subscribe to, add the user ID in this list. If you want to remove a user from the blocklist, you need to call the setSubscribeAudioBlocklist method to update the user ID list; this means you only add the uid of users that you do not want to subscribe to in the new user ID list.
- uidNumber
- The number of users in the user ID list.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setSubscribeAudioAllowlist
Sets the allowlist of subscriptions for audio streams.
Future<void> setSubscribeAudioAllowlist( {required List<int> uidList, required int uidNumber});
Details
You can call this method to specify the audio streams of a user that you want to subscribe to.
- You can call this method either before or after joining a channel.
- The allowlist is not affected by the setting in muteRemoteAudioStream, muteAllRemoteAudioStreams and autoSubscribeAudio in ChannelMediaOptions.
- Once the allowlist of subscriptions is set, it is effective even if you leave the current channel and rejoin the channel.
- If a user is added in the allowlist and blocklist at the same time, only the blocklist takes effect.
Parameters
- uidList
-
The user ID list of users that you want to subscribe to.
If you want to specify the audio streams of a user for subscription, add the user ID in this list. If you want to remove a user from the allowlist, you need to call the setSubscribeAudioAllowlist method to update the user ID list; this means you only add the uid of users that you want to subscribe to in the new user ID list.
- uidNumber
- The number of users in the user ID list.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setSubscribeVideoBlocklist
Set the blocklist of subscriptions for video streams.
Future<void> setSubscribeVideoBlocklist( {required List<int> uidList, required int uidNumber});
Details
You can call this method to specify the video streams of a user that you do not want to subscribe to.
- You can call this method either before or after joining a channel.
- The blocklist is not affected by the setting in muteRemoteVideoStream, muteAllRemoteVideoStreams and autoSubscribeAudio in ChannelMediaOptions.
- Once the blocklist of subscriptions is set, it is effective even if you leave the current channel and rejoin the channel.
- If a user is added in the allowlist and blocklist at the same time, only the blocklist takes effect.
Parameters
- uidList
-
The user ID list of users that you do not want to subscribe to.
If you want to specify the video streams of a user that you do not want to subscribe to, add the user ID of that user in this list. If you want to remove a user from the blocklist, you need to call the setSubscribeVideoBlocklist method to update the user ID list; this means you only add the uid of users that you do not want to subscribe to in the new user ID list.
- uidNumber
- The number of users in the user ID list.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setSubscribeVideoAllowlist
Set the allowlist of subscriptions for video streams.
Future<void> setSubscribeVideoAllowlist( {required List<int> uidList, required int uidNumber});
Details
You can call this method to specify the video streams of a user that you want to subscribe to.
- You can call this method either before or after joining a channel.
- The allowlist is not affected by the setting in muteRemoteVideoStream, muteAllRemoteVideoStreams and autoSubscribeAudio in ChannelMediaOptions.
- Once the allowlist of subscriptions is set, it is effective even if you leave the current channel and rejoin the channel.
- If a user is added in the allowlist and blocklist at the same time, only the blocklist takes effect.
Parameters
- uidList
-
The user ID list of users that you want to subscribe to.
If you want to specify the video streams of a user for subscription, add the user ID of that user in this list. If you want to remove a user from the allowlist, you need to call the setSubscribeVideoAllowlist method to update the user ID list; this means you only add the uid of users that you want to subscribe to in the new user ID list.
- uidNumber
- The number of users in the user ID list.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setVideoDenoiserOptions
Sets video noise reduction.
Future<void> setVideoDenoiserOptions( {required bool enabled, required VideoDenoiserOptions options, MediaSourceType type = MediaSourceType.primaryCameraSource});
You can call this method to enable the video noise reduction feature and set the options of the video noise reduction effect.
- lighteningContrastLevellighteningContrastNormal
- lighteningLevel: 0.0
- smoothnessLevel: 0.5
- rednessLevel: 0.0
- sharpnessLevel: 0.1
Applicable scenarios
dark environments and low-end video capture devices can cause video images to contain significant noise, which affects video quality. In real-time interactive scenarios, video noise also consumes bitstream resources and reduces encoding efficiency during encoding.
Call timing
Call this method after calling enableVideo.
Restrictions
- This method relies on the image enhancement dynamic library
libagora_clear_vision_extension.dll
. If the dynamic library is deleted, the function cannot be enabled normally. - Video noise reduction has certain requirements for equipment performance. If your device overheats after you enable video noise reduction, Agora recommends modifying the video noise reduction options to a less performance-consuming level or disabling video noise reduction entirely.
Parameters
- enabled
- Whether to enable video noise reduction:
true
: Enable video noise reduction.false
: (Default) Disable video noise reduction.
- options
- The video noise reduction options. See VideoDenoiserOptions.
- type
- The type of the media source to which the filter effect is applied. See MediaSourceType.Attention: In this method, this parameter supports only the following two settings:
- Use the default value primaryCameraSource if you use camera to capture local video.
- Set this parameter to customVideoSource if you use custom video source.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setVideoEncoderConfiguration
Sets the video encoder configuration.
Future<void> setVideoEncoderConfiguration(VideoEncoderConfiguration config);
Sets the encoder configuration for the local video. Each configuration profile corresponds to a set of video parameters, including the resolution, frame rate, and bitrate.
Call timing
You can call this method either before or after joining a channel. If the user does not need to reset the video encoding properties after joining the channel, Agora recommends calling this method before enableVideo to reduce the time to render the first video frame.
Restrictions
- The config specified in this method is the maximum value under ideal network conditions. If the video engine cannot render the video using the specified config due to unreliable network conditions, the parameters further down the list are considered until a successful configuration is found.
Parameters
- config
- Video profile. See VideoEncoderConfiguration.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setupLocalVideo
Initializes the local video view.
Future<void> setupLocalVideo(VideoCanvas canvas);
This method initializes the video view of a local stream on the local device. It only affects the video seen by the local user and does not impact the publishing of the local video. Call this method to bind the local video stream to a video view (view) and to set the rendering and mirror modes of the video view.
The binding remains valid after leaving the channel. To stop rendering or unbind the local video from the view, set view as NULL.
- In Flutter, you don't need to call this method. Use AgoraVideoView instead to render local and remote views.
- To update only the rendering or mirror mode of the local video view during a call, call setLocalRenderMode instead.
Applicable scenarios
After initialization, call this method to set the local video and then join the channel.
In real-time interactive scenarios, if you need to simultaneously view multiple preview frames in the local video preview, and each frame is at a different observation position along the video link, you can repeatedly call this method to set different views and set different observation positions for each view. For example, by setting the video source to the camera and then configuring two views with position setting to positionPostCapturerOrigin and positionPostCapturer, you can simultaneously preview the raw, unprocessed video frame and the video frame that has undergone preprocessing (image enhancement effects, virtual background, watermark) in the local video preview.
Call timing
You can call this method either before or after joining a channel.
Restrictions
None.
Parameters
- canvas
- The local video view and settings. See VideoCanvas.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
- < 0: Failure.
setupRemoteVideo
Initializes the video view of a remote user.
Future<void> setupRemoteVideo(VideoCanvas canvas);
Details
This method initializes the video view of a remote stream on the local device. It affects only the video view that the local user sees. Call this method to bind the remote video stream to a video view and to set the rendering and mirror modes of the video view.
You need to specify the ID of the remote user in this method. If the remote user ID is unknown to the application, set it after the app receives the onUserJoined callback.
To unbind the remote user from the view, set the view parameter to NULL.
Once the remote user leaves the channel, the SDK unbinds the remote user.
In the scenarios of custom layout for mixed videos on the mobile end, you can call this method and set a separate view for rendering each sub-video stream of the mixed video stream.
- In Flutter, you don't need to call this method. Use AgoraVideoView instead to render local and remote views.
- To update the rendering or mirror mode of the remote video view during a call, use the setRemoteRenderMode method.
- When using the recording service, the app does not need to bind a view, as it does not send a video stream. If your app does not recognize the recording service, bind the remote user to the view when the SDK triggers the onFirstRemoteVideoDecoded callback.
Parameters
- canvas
-
The remote video view and settings. See VideoCanvas.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
- < 0: Failure.
setVideoScenario
Sets video application scenarios.
Future<void> setVideoScenario(VideoApplicationScenarioType scenarioType);
Details
After successfully calling this method, the SDK will automatically enable the best practice strategies and adjust key performance metrics based on the specified scenario, to optimize the video experience.
Parameters
- scenarioType
- The type of video application scenario. See VideoApplicationScenarioType.applicationScenarioMeeting (1) is suitable for meeting scenarios. The SDK automatically enables the following strategies:
- In meeting scenarios where low-quality video streams are required to have a high bitrate, the SDK automatically enables multiple technologies used to deal with network congestions, to enhance the performance of the low-quality streams and to ensure the smooth reception by subscribers.
- The SDK monitors the number of subscribers to the high-quality video stream in real time and dynamically adjusts its configuration based on the number of subscribers.
- If nobody subscribers to the high-quality stream, the SDK automatically reduces its bitrate and frame rate to save upstream bandwidth.
- If someone subscribes to the high-quality stream, the SDK resets the high-quality stream to the VideoEncoderConfiguration configuration used in the most recent calling of setVideoEncoderConfiguration. If no configuration has been set by the user previously, the following values are used:
- Resolution: (Windows and macOS) 1280 Ă— 720; (Android and iOS) 960 Ă— 540
- Frame rate: 15 fps
- Bitrate: (Windows and macOS) 1600 Kbps; (Android and iOS) 1000 Kbps
- The SDK monitors the number of subscribers to the low-quality video stream in real time and dynamically enables or disables it based on the number of subscribers.Note: If the user has called setDualStreamMode to set that never send low-quality video stream (disableSimulcastStream), the dynamic adjustment of the low-quality stream in meeting scenarios will not take effect.
- If nobody subscribes to the low-quality stream, the SDK automatically disables it to save upstream bandwidth.
- If someone subscribes to the low-quality stream, the SDK enables the low-quality stream and resets it to the SimulcastStreamConfig configuration used in the most recent calling of setDualStreamMode. If no configuration has been set by the user previously, the following values are used:
- Resolution: 480 Ă— 272
- Frame rate: 15 fps
- Bitrate: 500 Kbps
applicationScenario1v1(2) This is applicable to the one to one live scenario. To meet the requirements for low latency and high-quality video in this scenario, the SDK optimizes its strategies, improving performance in terms of video quality, first frame rendering, latency on mid-to-low-end devices, and smoothness under weak network conditions.
applicationScenarioLiveshow(3) This is applicable to the show room scenario. In this scenario, fast video rendering and high image quality are crucial. The SDK implements several performance optimizations, including automatically enabling accelerated audio and video frame rendering to minimize first-frame latency (no need to call enableInstantMediaRendering), and B-frame encoding to achieve better image quality and bandwidth efficiency. The SDK also provides enhanced video quality and smooth playback, even in poor network conditions or on lower-end devices.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setVoiceBeautifierParameters
Sets parameters for the preset voice beautifier effects.
Future<void> setVoiceBeautifierParameters( {required VoiceBeautifierPreset preset, required int param1, required int param2});
Details
Call this method to set a gender characteristic and a reverberation effect for the singing beautifier effect. This method sets parameters for the local user who sends an audio stream. After setting the audio parameters, all users in the channel can hear the effect.
- Call setAudioScenario to set the audio scenario to high-quality audio scenario, namely audioScenarioGameStreaming(3).
- Call setAudioProfile to set the profile parameter to audioProfileMusicHighQuality(4) or audioProfileMusicHighQualityStereo(5).
- You can call this method either before or after joining a channel.
- Do not set the profile parameter in setAudioProfile to audioProfileSpeechStandard(1) or audioProfileIot(6), or the method does not take effect.
- This method has the best effect on human voice processing, and Agora does not recommend calling this method to process audio data containing music.
- After calling setVoiceBeautifierParameters, Agora does not recommend calling the following methods, otherwise the effect set by setVoiceBeautifierParameters will be overwritten:
- This method relies on the voice beautifier dynamic library
libagora_audio_beauty_extension.dll
. If the dynamic library is deleted, the function cannot be enabled normally.
Parameters
- preset
- The option for the preset audio effect:
SINGING_BEAUTIFIER
: The singing beautifier effect.
- param1
- The gender characteristics options for the singing voice:
1
: A male-sounding voice.2
: A female-sounding voice.
- param2
- The reverberation effect options for the singing voice:
1
: The reverberation effect sounds like singing in a small room.2
: The reverberation effect sounds like singing in a large room.3
: The reverberation effect sounds like singing in a hall.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setVoiceBeautifierPreset
Sets a preset voice beautifier effect.
Future<void> setVoiceBeautifierPreset(VoiceBeautifierPreset preset);
Call this method to set a preset voice beautifier effect for the local user who sends an audio stream. After setting a voice beautifier effect, all users in the channel can hear the effect. You can set different voice beautifier effects for different scenarios.
Call timing
This method can be called either before or after joining the channel.
- Call setAudioScenario to set the audio scenario to high-quality audio scenario, namely audioScenarioGameStreaming(3).
- Call setAudioProfile to set the profile parameter to audioProfileMusicHighQuality(4) or audioProfileMusicHighQualityStereo(5).
Restrictions
- Do not set the profile parameter in setAudioProfile to audioProfileSpeechStandard(1) or audioProfileIot(6), or the method does not take effect.
- This method has the best effect on human voice processing, and Agora does not recommend calling this method to process audio data containing music.
- After calling setVoiceBeautifierPreset, Agora does not recommend calling the following methods, otherwise the effect set by setVoiceBeautifierPreset will be overwritten:
- This method relies on the voice beautifier dynamic library
libagora_audio_beauty_extension.dll
. If the dynamic library is deleted, the function cannot be enabled normally.
Parameters
- preset
-
The preset voice beautifier effect options: VoiceBeautifierPreset.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setVoiceConversionPreset
Sets a preset voice beautifier effect.
Future<void> setVoiceConversionPreset(VoiceConversionPreset preset);
Call this method to set a preset voice changing effect for the local user who publishes an audio stream in a channel. After setting the voice changing effect, all users in the channel can hear the effect. You can set different voice changing effects for the user depending on different scenarios.
Call timing
This method can be called either before or after joining the channel.
- Call setAudioScenario to set the audio scenario to high-quality audio scenario, namely audioScenarioGameStreaming(3).
- Call setAudioProfile to set the profile parameter to audioProfileMusicHighQuality(4) or audioProfileMusicHighQualityStereo(5).
Restrictions
- Do not set the profile parameter in setAudioProfile to audioProfileSpeechStandard(1) or audioProfileIot(6), or the method does not take effect.
- This method has the best effect on human voice processing, and Agora does not recommend calling this method to process audio data containing music.
- After calling setVoiceConversionPreset, Agora does not recommend you to call the following methods, otherwise the effect set by setVoiceConversionPreset will be overwritten:
- This method relies on the voice beautifier dynamic library
libagora_audio_beauty_extension.dll
. If the dynamic library is deleted, the function cannot be enabled normally.
Parameters
- preset
-
The options for the preset voice beautifier effects: VoiceConversionPreset.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
- < 0: Failure.
setVolumeOfEffect
Gets the volume of a specified audio effect file.
Future<void> setVolumeOfEffect({required int soundId, required int volume});
Call timing
Call this method after playEffect.
Restrictions
None.
Parameters
- soundId
- The ID of the audio effect. The ID of each audio effect file is unique.
- volume
- The playback volume. The value range is [0, 100]. The default value is 100, which represents the original volume.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
startAudioMixing
Starts playing the music file.
Future<void> startAudioMixing( {required String filePath, required bool loopback, required int cycle, int startPos = 0});
For the audio file formats supported by this method, see What formats of audio files does the Agora RTC SDK support. If the local music file does not exist, the SDK does not support the file format, or the the SDK cannot access the music file URL, the SDK reports audioMixingReasonCanNotOpen.
Call timing
You can call this method either before or after joining a channel.
Restrictions
- If you call this method to play short sound effect files, you may encounter playback failure. Agora recommends using playEffect instead to play such files.
- If you need to call this method multiple times, ensure that the time interval between calling this method is more than 500 ms.
- On Android, there are following considerations:
- To use this method, ensure that the Android device is v4.2 or later, and the API version is v16 or later.
- If you need to play an online music file, Agora does not recommend using the redirected URL address. Some Android devices may fail to open a redirected URL address.
- If you call this method on an emulator, ensure that the music file is in the
/sdcard/
directory and the format is MP3.
Parameters
- filePath
- File path:
- Android: The file path, which needs to be accurate to the file name and suffix. Agora supports URL addresses, absolute paths, or file paths that start with
/assets/
. You might encounter permission issues if you use an absolute path to access a local file, so Agora recommends using a URI address instead. For example: content://com.android.providers.media.documents/document/audio%3A14441
- Windows: The absolute path or URL address (including the suffixes of the filename) of the audio effect file. For example
: C:\music\audio.mp4
. - iOS or macOS: The absolute path or URL address (including the suffixes of the filename) of the audio effect file. For example:
/var/mobile/Containers/Data/audio.mp4
.
- Android: The file path, which needs to be accurate to the file name and suffix. Agora supports URL addresses, absolute paths, or file paths that start with
- loopback
-
Whether to only play music files on the local client:
true
: Only play music files on the local client so that only the local user can hear the music.false
: Publish music files to remote clients so that both the local user and remote users can hear the music.
- cycle
-
The number of times the music file plays.
- >0: The number of times for playback. For example, 1 represents playing 1 time.
- -1: Play the audio file in an infinite loop.
- startPos
- The playback position (ms) of the music file.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
startAudioRecording
Starts audio recording on the client and sets recording configurations.
Future<void> startAudioRecording(AudioRecordingConfiguration config);
- WAV: High-fidelity files with typically larger file sizes. For example, if the sample rate is 32,000 Hz, the file size for 10-minute recording is approximately 73 MB.
- AAC: Low-fidelity files with typically smaller file sizes. For example, if the sample rate is 32,000 Hz and the recording quality is audioRecordingQualityMedium, the file size for 10-minute recording is approximately 2 MB.
Once the user leaves the channel, the recording automatically stops.
Call timing
Call this method after joining a channel.
Restrictions
None.
Parameters
- config
- Recording configurations. See AudioRecordingConfiguration.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
startCameraCapture
Starts camera capture.
Future<void> startCameraCapture( {required VideoSourceType sourceType, required CameraCapturerConfiguration config});
Details
You can call this method to start capturing video from one or more cameras by specifying sourceType.
true
before calling this method.Parameters
- sourceType
-
The type of the video source. See VideoSourceType.
Note:- On iOS devices, you can capture video from up to 2 cameras, provided the device has multiple cameras or supports external cameras.
- On Android devices, you can capture video from up to 4 cameras, provided the device has multiple cameras or supports external cameras.
- On the desktop platforms, you can capture video from up to 4 cameras.
- config
-
The configuration of the video capture. See CameraCapturerConfiguration.
Note: On the iOS platform, this parameter has no practical function. Use the config parameter in enableMultiCamera instead to set the video capture configuration.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
startDirectCdnStreaming
Starts pushing media streams to the CDN directly.
Future<void> startDirectCdnStreaming( {required DirectCdnStreamingEventHandler eventHandler, required String publishUrl, required DirectCdnStreamingMediaOptions options});
Details
Aogra does not support pushing media streams to one URL repeatedly.
Media options
Agora does not support setting the value of publishCameraTrack and publishCustomVideoTrack as true
, or the value of publishMicrophoneTrack and publishCustomAudioTrack as true
at the same time. When choosing media setting options (DirectCdnStreamingMediaOptions), you can refer to the following examples:
If you want to push audio and video streams captured by the host from a custom source, the media setting options should be set as follows:
- publishCustomAudioTrack is set as
true
and call the pushAudioFrame method - publishCustomVideoTrack is set as
true
and call the pushVideoFrame method - publishCameraTrack is set as
false
(the default value) - publishMicrophoneTrack is set as
false
(the default value)
true
and call pushAudioFrame to push audio streams. Parameters
- eventHandler
- See onDirectCdnStreamingStateChanged and onDirectCdnStreamingStats.
- publishUrl
- The CDN live streaming URL.
- options
- The media setting options for the host. See DirectCdnStreamingMediaOptions.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
startEchoTest
Starts an audio device loopback test.
Future<void> startEchoTest(EchoTestConfiguration config);
To test whether the user's local sending and receiving streams are normal, you can call this method to perform an audio and video call loop test, which tests whether the audio and video devices and the user's upstream and downstream networks are working properly.
After starting the test, the user needs to make a sound or face the camera. The audio or video is output after about two seconds. If the audio playback is normal, the audio device and the user's upstream and downstream networks are working properly; if the video playback is normal, the video device and the user's upstream and downstream networks are working properly.
Call timing
You can call this method either before or after joining a channel.
Restrictions
- When calling in a channel, make sure that no audio or video stream is being published.
- After calling this method, call stopEchoTest to end the test; otherwise, the user cannot perform the next audio and video call loop test and cannot join the channel.
- In live streaming scenarios, this method only applies to hosts.
Parameters
- config
- The configuration of the audio and video call loop test. See EchoTestConfiguration.
Returns
- 0: Success.
- < 0: Failure.
startLastmileProbeTest
Starts the last mile network probe test.
Future<void> startLastmileProbeTest(LastmileProbeConfig config);
This method starts the last-mile network probe test before joining a channel to get the uplink and downlink last mile network statistics, including the bandwidth, packet loss, jitter, and round-trip time (RTT).
Call timing
Do not call other methods before receiving the onLastmileQuality and onLastmileProbeResult callbacks. Otherwise, the callbacks may be interrupted.
Restrictions
None.
Parameters
- config
- The configurations of the last-mile network probe test. See LastmileProbeConfig.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
startLocalAudioMixer
Starts local audio mixing.
Future<void> startLocalAudioMixer(LocalAudioMixerConfiguration config);
- If you want to mix the locally captured audio streams, you can set publishMixedAudioTrack in ChannelMediaOptions to
true
, and then publish the mixed audio stream to the channel. - If you want to mix the remote audio stream, ensure that the remote audio stream has been published in the channel and you have subcribed to the audio stream that you need to mix.
Applicable scenarios
- By utilizing the local video mixing feature, the associated audio streams of the mixed video streams can be simultaneously captured and published.
- In live streaming scenarios, users can receive audio streams within the channel, mix multiple audio streams locally, and then forward the mixed audio stream to other channels.
- In online classes, teachers can mix the audio from interactions with students locally and then forward the mixed audio stream to other channels.
Call timing
You can call this method either before or after joining a channel.
Restrictions
To ensure audio quality, it is recommended that the number of audio streams to be mixed does not exceed 10.
Parameters
- config
- The configurations for mixing the lcoal audio. See LocalAudioMixerConfiguration.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
startLocalVideoTranscoder
Starts the local video mixing.
Future<void> startLocalVideoTranscoder(LocalTranscoderConfiguration config);
After calling this method, you can merge multiple video streams into one video stream locally. For example, you can merge the video streams captured by the camera, screen sharing, media player, remote video, video files, images, etc. into one video stream, and then publish the mixed video stream to the channel.
Applicable scenarios
You can enable the local video mixing function in scenarios such as remote conferences, live streaming, and online education, which allows users to view and manage multiple videos more conveniently, and supports portrait-in-picture effect and other functions.
- Call enableVirtualBackground, and set the custom background image to backgroundNone, that is, separate the portrait and the background in the video captured by the camera.
- Call startScreenCaptureBySourceType to start capturing the screen sharing video stream.
- Call this method and set the video source for capturing portraits as one of the video sources participating in the local video mixing, picture-in-picture of the portrait can be achived in the mixed video.
Call timing
- If you need to mix the locally collected video streams, you need to call this method after startCameraCapture or startScreenCaptureBySourceType.
- If you want to publish the mixed video stream to the channel, you need to set publishTranscodedVideoTrack in ChannelMediaOptions to
true
when calling joinChannel or updateChannelMediaOptions.
Restrictions
- Local video mixing requires more CPU resources. Therefore, Agora recommends enabling this function on devices with higher performance.
- If you need to mix locally captured video streams, the SDK supports the following capture combinations:
- On the Windows platform, it supports up to 4 video streams captured by cameras + 4 screen sharing streams.
- On the macOS platform, it supports up to 4 video streams captured by cameras + 1 screen sharing stream.
- On Android and iOS platforms, it supports video streams captured by up to 2 cameras (the device itself needs to support dual cameras or supports external cameras) + 1 screen sharing stream.
- When configuring the local video mixing, it is necessary to ensure that the layer number of the video stream capturing the portrait is greater than the layer number of the screen sharing stream. Otherwise, the portrait will be covered by the screen sharing and will not be displayed in the final mixed video stream.
Parameters
- config
- Configuration of the local video mixing, see LocalTranscoderConfiguration.Attention:
- The maximum resolution of each video stream participating in the local video mixing is 4096 Ă— 2160. If this limit is exceeded, video mixing does not take effect.
- The maximum resolution of the mixed video stream is 4096 Ă— 2160.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
startMediaRenderingTracing
Enables tracing the video frame rendering process.
Future<void> startMediaRenderingTracing();
Details
The SDK starts tracing the rendering status of the video frames in the channel from the moment this method is successfully called and reports information about the event through the onVideoRenderingTracingResult callback.
- By default, the SDK starts tracing the video rendering event automatically when the local user successfully joins the channel. You can call this method at an appropriate time according to the actual application scenario to customize the tracing process.
- After the local user leaves the current channel, the SDK automatically resets the time point to the next time when the user successfully joins the channel.
Applicable scenarios
Agora recommends that you use this method in conjunction with the UI settings (such as buttons and sliders) in your app to improve the user experience. For example, call this method when the user clicks the Join Channel
button, and then get the indicators in the video frame rendering process through the onVideoRenderingTracingResult callback, so as to optimize the indicators accordingly.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
startOrUpdateChannelMediaRelay
Starts relaying media streams across channels or updates channels for media relay.
Future<void> startOrUpdateChannelMediaRelay( ChannelMediaRelayConfiguration configuration);
Details
The first successful call to this method starts relaying media streams from the source channel to the destination channels. To relay the media stream to other channels, or exit one of the current media relays, you can call this method again to update the destination channels. This feature supports relaying media streams to a maximum of six destination channels.
- If the onChannelMediaRelayStateChanged callback returns relayStateRunning (2) and relayOk (0), it means that the SDK starts relaying media streams from the source channel to the destination channel.
- If the onChannelMediaRelayStateChanged callback returns relayStateFailure (3), an exception occurs during the media stream relay.
- Call this method after joining the channel.
- This method takes effect only when you are a host in a live streaming channel.
- The relaying media streams across channels function needs to be enabled by contacting technical support.
- Agora does not support string user accounts in this API.
Parameters
- configuration
- The configuration of the media stream relay. See ChannelMediaRelayConfiguration.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
- < 0: Failure.
- -1: A general error occurs (no specified reason).
- -2: The parameter is invalid.
- -8: Internal state error. Probably because the user is not a broadcaster.
startPreviewWithoutSourceType
Enables the local video preview.
Future<void> startPreviewWithoutSourceType();
You can call this method to enable local video preview.
Call timing
This method must be called after enableVideo.
Restrictions
- The local preview enables the mirror mode by default.
- After leaving the channel, local preview remains enabled. You need to call stopPreview to disable local preview.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
startPreview
Enables the local video preview and specifies the video source for the preview.
Future<void> startPreview( {VideoSourceType sourceType = VideoSourceType.videoSourceCameraPrimary});
This method is used to start local video preview and specify the video source that appears in the preview screen.
Call timing
This method must be called after enableVideo.
Restrictions
- The local preview enables the mirror mode by default.
- After leaving the channel, local preview remains enabled. You need to call stopPreview to disable local preview.
Parameters
- sourceType
- The type of the video source. See VideoSourceType.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
startRhythmPlayer
Enables the virtual metronome.
Future<void> startRhythmPlayer( {required String sound1, required String sound2, required AgoraRhythmPlayerConfig config});
- After enabling the virtual metronome, the SDK plays the specified audio effect file from the beginning, and controls the playback duration of each file according to beatsPerMinute you set in AgoraRhythmPlayerConfig. For example, if you set beatsPerMinute as
60
, the SDK plays one beat every second. If the file duration exceeds the beat duration, the SDK only plays the audio within the beat duration. - By default, the sound of the virtual metronome is published in the channel. If you want the sound to be heard by the remote users, you can set publishRhythmPlayerTrack in ChannelMediaOptions as
true
.
Applicable scenarios
In music education, physical education and other scenarios, teachers usually need to use a metronome so that students can practice with the correct beat. The meter is composed of a downbeat and upbeats. The first beat of each measure is called a downbeat, and the rest are called upbeats.
Call timing
This method can be called either before or after joining the channel.
Restrictions
None.
Parameters
- sound1
- The absolute path or URL address (including the filename extensions) of the file for the downbeat. For example,
C:\music\audio.mp4
. For the audio file formats supported by this method, see What formats of audio files does the Agora RTC SDK support. - sound2
- The absolute path or URL address (including the filename extensions) of the file for the upbeats. For example,
C:\music\audio.mp4
. For the audio file formats supported by this method, see What formats of audio files does the Agora RTC SDK support. - config
- The metronome configuration. See AgoraRhythmPlayerConfig.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
startRtmpStreamWithoutTranscoding
Starts pushing media streams to a CDN without transcoding.
Future<void> startRtmpStreamWithoutTranscoding(String url);
Details
Agora recommends that you use the server-side Media Push function. For details, see Use RESTful API.
You can call this method to push an audio or video stream to the specified CDN address. This method can push media streams to only one CDN address at a time, so if you need to push streams to multiple addresses, call this method multiple times.
After you call this method, the SDK triggers the onRtmpStreamingStateChanged callback on the local client to report the state of the streaming.
- Call this method after joining a channel.
- Only hosts in the LIVE_BROADCASTING profile can call this method.
- If you want to retry pushing streams after a failed push, make sure to call stopRtmpStream first, then call this method to retry pushing streams; otherwise, the SDK returns the same error code as the last failed push.
Parameters
- url
- The address of Media Push. The format is RTMP or RTMPS. The character length cannot exceed 1024 bytes. Special characters such as Chinese characters are not supported.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
startRtmpStreamWithTranscoding
Starts Media Push and sets the transcoding configuration.
Future<void> startRtmpStreamWithTranscoding( {required String url, required LiveTranscoding transcoding});
Details
Agora recommends that you use the server-side Media Push function. For details, see Use RESTful API.
You can call this method to push a live audio-and-video stream to the specified CDN address and set the transcoding configuration. This method can push media streams to only one CDN address at a time, so if you need to push streams to multiple addresses, call this method multiple times.
Under one Agora project, the maximum number of concurrent tasks to push media streams is 200 by default. If you need a higher quota, contact technical support.
After you call this method, the SDK triggers the onRtmpStreamingStateChanged callback on the local client to report the state of the streaming.
- Call this method after joining a channel.
- Only hosts in the LIVE_BROADCASTING profile can call this method.
- If you want to retry pushing streams after a failed push, make sure to call stopRtmpStream first, then call this method to retry pushing streams; otherwise, the SDK returns the same error code as the last failed push.
Parameters
- url
- The address of Media Push. The format is RTMP or RTMPS. The character length cannot exceed 1024 bytes. Special characters such as Chinese characters are not supported.
- transcoding
-
The transcoding configuration for Media Push. See LiveTranscoding.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
startScreenCapture
Starts screen capture.
Future<void> startScreenCapture(ScreenCaptureParameters2 captureParams);
- This method is for Android and iOS only.
- The billing for the screen sharing stream is based on the dimensions in ScreenVideoParameters:
- When you do not pass in a value, Agora bills you at 1280 Ă— 720.
- When you pass in a value, Agora bills you at that value.
Applicable scenarios
In the screen sharing scenario, you need to call this method to start capturing the screen video stream. For implementation guidance of screen sharing, please refer to .
Call timing
- Call this method first and then call joinChannel to join channel and set publishScreenCaptureVideo to
true
to start screen sharing. - Call this method after joining a channel, then call updateChannelMediaOptions and set publishScreenCaptureVideo to
true
to start screen sharing.
Restrictions
- On the iOS platform, screen sharing is only available on iOS 12.0 and later.
- If you are using the custom audio source instead of the SDK to capture audio, Agora recommends you add the keep-alive processing logic to your application to avoid screen sharing stopping when the application goes to the background.
- This feature requires high-performance device, and Agora recommends that you use it on iPhone X and later models.
- This method relies on the iOS screen sharing dynamic library
AgoraReplayKitExtension.xcframework
. If the dynamic library is deleted, screen sharing cannot be enabled normally. - On the Android platform, if the user has not granted the app screen capture permission, the SDK reports the onPermissionError
(2)
callback. - On Android 9 and later, to avoid the application being killed by the system after going to the background, Agora recommends you add the foreground service
android.permission.FOREGROUND_SERVICE
to the/app/Manifests/AndroidManifest.xml
file. - Due to performance limitations, screen sharing is not supported on Android TV.
- Due to system limitations, if you are using Huawei phones, do not adjust the video encoding resolution of the screen sharing stream during the screen sharing, or you could experience crashes.
- Due to system limitations, some Xiaomi devices do not support capturing system audio during screen sharing.
- To avoid system audio capture failure when sharing screen, Agora recommends that you set the audio application scenario to audioScenarioGameStreaming by using the setAudioScenario method before joining the channel.
Parameters
- captureParams
- The screen sharing encoding parameters. See ScreenCaptureParameters2.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
startScreenCaptureBySourceType
Starts screen capture from the specified video source.
Future<void> startScreenCaptureBySourceType( {required VideoSourceType sourceType, required ScreenCaptureConfiguration config});
Applicable scenarios
In the screen sharing scenario, you need to call this method to start capturing the screen video stream.
- startScreenCapture/startScreenCaptureByDisplayId/startScreenCaptureByWindowId: Only supports capturing a single screen or window, suitable for scenarios where only a single screen is shared.
- startScreenCaptureBySourceType: Supports specifying multiple video sources to capture multiple screen sharing streams, used for local video mixing or multi-channel scenarios.
Call timing
- Call this method first and then call joinChannel to join channel and set publishScreenCaptureVideo to
true
to start screen sharing. - Call this method after joining a channel, then call updateChannelMediaOptions and set publishScreenCaptureVideo to
true
to start screen sharing.
Restrictions
- If you start screen capture by calling this method, you need to call stopScreenCaptureBySourceType to stop screen capture.
- On the Windows platform, it supports up to four screen capture video streams.
- On the macOS platform, it supports only one screen capture video stream.
Parameters
- sourceType
- The type of the video source. See VideoSourceType.Attention: On the macOS platform, this parameter can only be set to videoSourceScreen (2).
- config
- The configuration of the captured screen. See ScreenCaptureConfiguration.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
startScreenCaptureByDisplayId
Captures the screen by specifying the display ID.
Future<void> startScreenCaptureByDisplayId( {required int displayId, required Rectangle regionRect, required ScreenCaptureParameters captureParams});
Captures the video stream of a screen or a part of the screen area.
Applicable scenarios
In the screen sharing scenario, you need to call this method to start capturing the screen video stream. For implementation guidance of screen sharing, please refer to .
Call timing
- Call this method before joining a channel, and then call joinChannel to join a channel and set publishScreenTrack or publishSecondaryScreenTrack to
true
to start screen sharing. - Call this method after joining a channel, and then call updateChannelMediaOptions to join a channel and set publishScreenTrack or publishSecondaryScreenTrack to
true
to start screen sharing.
Restrictions
None.
Parameters
- displayId
- The display ID of the screen to be shared.Note: For the Windows platform, if you need to simultaneously share two screens (main screen and secondary screen), you can set displayId to
-1
when calling this method. - regionRect
- (Optional) Sets the relative location of the region to the screen. Pass in
nil
to share the entire screen. See Rectangle. - captureParams
- Screen sharing configurations. The default video dimension is 1920 x 1080, that is, 2,073,600 pixels. Agora uses the value of this parameter to calculate the charges. See ScreenCaptureParameters.Attention: The video properties of the screen sharing stream only need to be set through this parameter, and are unrelated to setVideoEncoderConfiguration.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
startScreenCaptureByScreenRect
Captures the whole or part of a screen by specifying the screen rect.
Future<void> startScreenCaptureByScreenRect( {required Rectangle screenRect, required Rectangle regionRect, required ScreenCaptureParameters captureParams});
Details
- Deprecated:
- This method is deprecated. Use startScreenCaptureByDisplayId instead. Agora strongly recommends using startScreenCaptureByDisplayId if you need to start screen sharing on a device connected to another display.
This method shares a screen or part of the screen. You need to specify the area of the screen to be shared.
- Call this method before joining a channel, and then call joinChannel to join a channel and set publishScreenTrack or publishSecondaryScreenTrack to
true
to start screen sharing. - Call this method after joining a channel, and then call updateChannelMediaOptions to join a channel and set publishScreenTrack or publishSecondaryScreenTrack to
true
to start screen sharing.
Parameters
- screenRect
- Sets the relative location of the screen to the virtual screen.
- regionRect
- Sets the relative location of the region to the screen. If you do not set this parameter, the SDK shares the whole screen. See Rectangle. If the specified region overruns the screen, the SDK shares only the region within it; if you set width or height as 0, the SDK shares the whole screen.
- captureParams
- The screen sharing encoding parameters. The default video resolution is 1920 Ă— 1080, that is, 2,073,600 pixels. Agora uses the value of this parameter to calculate the charges. See ScreenCaptureParameters.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
startScreenCaptureByWindowId
Captures the whole or part of a window by specifying the window ID.
Future<void> startScreenCaptureByWindowId( {required int windowId, required Rectangle regionRect, required ScreenCaptureParameters captureParams});
This method captures a window or part of the window. You need to specify the ID of the window to be captured.
This method supports window sharing of UWP (Universal Windows Platform) applications. Agora tests the mainstream UWP applications by using the lastest SDK, see details as follows:
System version | Software | Compatible versions | Support |
---|---|---|---|
win10 | Chrome | 76.0.3809.100 | No |
Office Word | 18.1903.1152.0 | Yes | |
Office Excel | No | ||
Office PPT | Yes | ||
WPS Word | 11.1.0.9145 | Yes | |
WPS Excel | |||
WPS PPT | |||
Media Player (comes with the system) | All | Yes | |
win8 | Chrome | All | Yes |
Office Word | All | Yes | |
Office Excel | |||
Office PPT | |||
WPS Word | 11.1.0.9098 | Yes | |
WPS Excel | |||
WPS PPT | |||
Media Player (comes with the system) | All | Yes | |
win7 | Chrome | 73.0.3683.103 | No |
Office Word | All | Yes | |
Office Excel | |||
Office PPT | |||
WPS Word | 11.1.0.9098 | No | |
WPS Excel | |||
WPS PPT | 11.1.0.9098 | Yes | |
Media Player (comes with the system) | All | No |
Applicable scenarios
In the screen sharing scenario, you need to call this method to start capturing the screen video stream. For implementation guidance of screen sharing, please refer to .
Call timing
- Call this method before joining a channel, and then call joinChannel to join a channel and set publishScreenTrack or publishSecondaryScreenTrack to
true
to start screen sharing. - Call this method after joining a channel, and then call updateChannelMediaOptions to join a channel and set publishScreenTrack or publishSecondaryScreenTrack to
true
to start screen sharing.
Restrictions
The window sharing feature of the Agora SDK relies on WGC (Windows Graphics Capture) or GDI (Graphics Device Interface) capture, and WGC cannot be set to disable mouse capture on systems earlier than Windows 10 2004. Therefore, captureMouseCursor(false)
might not work when you start window sharing on a device with a system earlier than Windows 10 2004. See ScreenCaptureParameters.
Parameters
- windowId
- The ID of the window to be shared.
- regionRect
- (Optional) Sets the relative location of the region to the screen. If you do not set this parameter, the SDK shares the whole screen. See Rectangle. If the specified region overruns the window, the SDK shares only the region within it; if you set width or height as 0, the SDK shares the whole window.
- captureParams
- Screen sharing configurations. The default video resolution is 1920 Ă— 1080, that is, 2,073,600 pixels. Agora uses the value of this parameter to calculate the charges. See ScreenCaptureParameters.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
stopAllEffects
Stops playing all audio effects.
Future<void> stopAllEffects();
When you no longer need to play the audio effect, you can call this method to stop the playback. If you only need to pause the playback, call pauseAllEffects.
Call timing
Call this method after playEffect.
Restrictions
None.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
stopAudioMixing
Stops playing the music file.
Future<void> stopAudioMixing();
After calling startAudioMixing to play a music file, you can call this method to stop the playing. If you only need to pause the playback, call pauseAudioMixing.
Call timing
Call this method after joining a channel.
Restrictions
None.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
stopAudioRecording
Stops the audio recording on the client.
Future<void> stopAudioRecording();
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
stopCameraCapture
Stops camera capture.
Future<void> stopCameraCapture(VideoSourceType sourceType);
Details
After calling startCameraCapture to start capturing video through one or more cameras, you can call this method and set the sourceType parameter to stop the capture from the specified cameras.
false
.Parameters
- sourceType
- The type of the video source. See VideoSourceType.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
stopChannelMediaRelay
Stops the media stream relay. Once the relay stops, the host quits all the target channels.
Future<void> stopChannelMediaRelay();
Details
After a successful method call, the SDK triggers the onChannelMediaRelayStateChanged callback. If the callback reports relayStateIdle (0) and relayOk (0), the host successfully stops the relay.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
- < 0: Failure.
- -5: The method call was rejected. There is no ongoing channel media relay.
stopDirectCdnStreaming
Stops pushing media streams to the CDN directly.
Future<void> stopDirectCdnStreaming();
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
stopEchoTest
Stops the audio call test.
Future<void> stopEchoTest();
After calling startEchoTest, you must call this method to end the test; otherwise, the user cannot perform the next audio and video call loop test and cannot join the channel.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
stopEffect
Stops playing a specified audio effect.
Future<void> stopEffect(int soundId);
When you no longer need to play the audio effect, you can call this method to stop the playback. If you only need to pause the playback, call pauseEffect.
Call timing
Call this method after playEffect.
Restrictions
None.
Parameters
- soundId
- The ID of the audio effect. Each audio effect has a unique ID.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
stopLastmileProbeTest
Stops the last mile network probe test.
Future<void> stopLastmileProbeTest();
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
stopLocalAudioMixer
Stops the local audio mixing.
Future<void> stopLocalAudioMixer();
After calling startLocalAudioMixer, call this method if you want to stop the local audio mixing.
Call timing
Call this method after startLocalAudioMixer.
Restrictions
None.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
stopLocalVideoTranscoder
Stops the local video mixing.
Future<void> stopLocalVideoTranscoder();
Details
After calling startLocalVideoTranscoder, call this method if you want to stop the local video mixing.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
stopPreview
Stops the local video preview.
Future<void> stopPreview( {VideoSourceType sourceType = VideoSourceType.videoSourceCameraPrimary});
Applicable scenarios
After calling startPreview to start the preview, if you want to stop the local video preview, call this method.
Call timing
Call this method before joining a channel or after leaving a channel.
Restrictions
None.
Parameters
- sourceType
- The type of the video source. See VideoSourceType.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
- < 0: Failure.
stopRhythmPlayer
Disables the virtual metronome.
Future<void> stopRhythmPlayer();
Details
After calling startRhythmPlayer, you can call this method to disable the virtual metronome.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
stopRtmpStream
Stops pushing media streams to a CDN.
Future<void> stopRtmpStream(String url);
Details
Agora recommends that you use the server-side Media Push function. For details, see Use RESTful API.
You can call this method to stop the live stream on the specified CDN address. This method can stop pushing media streams to only one CDN address at a time, so if you need to stop pushing streams to multiple addresses, call this method multiple times.
After you call this method, the SDK triggers the onRtmpStreamingStateChanged callback on the local client to report the state of the streaming.
Parameters
- url
- The address of Media Push. The format is RTMP or RTMPS. The character length cannot exceed 1024 bytes. Special characters such as Chinese characters are not supported.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
stopScreenCapture
Stops screen capture.
Future<void> stopScreenCapture();
Applicable scenarios
If you start screen capture by calling startScreenCapture, startScreenCaptureByWindowId, or startScreenCaptureByDisplayId, you need to call this method to stop screen capture.
Call timing
You can call this method either before or after joining a channel.
Restrictions
None.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
stopScreenCaptureBySourceType
Stops screen capture from the specified video source.
Future<void> stopScreenCaptureBySourceType(VideoSourceType sourceType);
Applicable scenarios
If you start screen capture from one or more screens by calling startScreenCaptureBySourceType, you need to call this method to stop screen capture, specifying the screen through the sourceType parameter.
Call timing
You can call this method either before or after joining a channel.
Restrictions
None.
Parameters
- sourceType
- The type of the video source. See VideoSourceType.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
switchCamera
Switches between front and rear cameras.
Future<void> switchCamera();
You can call this method to dynamically switch cameras based on the actual camera availability during the app's runtime, without having to restart the video stream or reconfigure the video source.
Call timing
This method must be called after the camera is successfully enabled, that is, after the SDK triggers the onLocalVideoStateChanged callback and returns the local video state as localVideoStreamStateCapturing (1).
Restrictions
This method only switches the camera for the video stream captured by the first camera, that is, the video source set to videoSourceCamera (0) when calling startCameraCapture.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
takeSnapshot
Takes a snapshot of a video stream.
Future<void> takeSnapshot({required int uid, required String filePath});
This method takes a snapshot of a video stream from the specified user, generates a JPG image, and saves it to the specified path.
Call timing
Call this method after joining a channel.
Restrictions
- The method is asynchronous, and the SDK has not taken the snapshot when the method call returns.
- When used for local video snapshots, this method takes a snapshot for the video streams specified in ChannelMediaOptions.
- If the user's video has been preprocessed, for example, watermarked or beautified, the resulting snapshot includes the pre-processing effect.
Parameters
- uid
- The user ID. Set uid as 0 if you want to take a snapshot of the local user's video.
- filePath
-
The local path (including filename extensions) of the snapshot. For example:
- Windows:
C:\Users\<user_name>\AppData\Local\Agora\<process_name>\example.jpg
- iOS:
/App Sandbox/Library/Caches/example.jpg
- macOS:
~/Library/Logs/example.jpg
- Android:
/storage/emulated/0/Android/data/<package name>/files/example.jpg
Attention: Ensure that the path you specify exists and is writable. - Windows:
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
takeSnapshotWithConfig
Takes a screenshot of the video at the specified observation point.
Future<void> takeSnapshotWithConfig( {required int uid, required SnapshotConfig config});
This method takes a snapshot of a video stream from the specified user, generates a JPG image, and saves it to the specified path.
Call timing
Call this method after joining a channel.
Restrictions
- The method is asynchronous, and the SDK has not taken the snapshot when the method call returns.
- When used for local video snapshots, this method takes a snapshot for the video streams specified in ChannelMediaOptions.
Parameters
- uid
- The user ID. Set uid as 0 if you want to take a snapshot of the local user's video.
- config
- The configuration of the snaptshot. See SnapshotConfig.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
unloadAllEffects
Releases a specified preloaded audio effect from the memory.
Future<void> unloadAllEffects();
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
unloadEffect
Releases a specified preloaded audio effect from the memory.
Future<void> unloadEffect(int soundId);
After loading the audio effect file into memory using preloadEffect, if you need to release the audio effect file, call this method.
Call timing
You can call this method either before or after joining a channel.
Restrictions
None.
Parameters
- soundId
- The ID of the audio effect. Each audio effect has a unique ID.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
unregisterAudioEncodedFrameObserver
Unregisters the encoded audio frame observer.
void unregisterAudioEncodedFrameObserver(AudioEncodedFrameObserver observer);
Parameters
- observer
- The encoded audio observer. See AudioEncodedFrameObserver.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
unregisterAudioSpectrumObserver
Unregisters the audio spectrum observer.
void unregisterAudioSpectrumObserver(AudioSpectrumObserver observer);
Details
After calling registerAudioSpectrumObserver, if you want to disable audio spectrum monitoring, you can call this method.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
unregisterMediaMetadataObserver
Unregisters the specified metadata observer.
void unregisterMediaMetadataObserver( {required MetadataObserver observer, required MetadataType type});
Parameters
- observer
- The metadata observer. See MetadataObserver.
- type
-
The metadata type. The SDK currently only supports videoMetadata.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
- < 0: Failure.
updateChannelMediaOptions
Updates the channel media options after joining the channel.
Future<void> updateChannelMediaOptions(ChannelMediaOptions options);
Parameters
- options
- The channel media options. See ChannelMediaOptions.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
updateLocalAudioMixerConfiguration
Updates the configurations for mixing audio streams locally.
Future<void> updateLocalAudioMixerConfiguration( LocalAudioMixerConfiguration config);
After calling startLocalAudioMixer, call this method if you want to update the local audio mixing configuration.
Call timing
Call this method after startLocalAudioMixer.
Restrictions
To ensure audio quality, it is recommended that the number of audio streams to be mixed does not exceed 10.
Parameters
- config
- The configurations for mixing the lcoal audio. See LocalAudioMixerConfiguration.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
updateLocalTranscoderConfiguration
Updates the local video mixing configuration.
Future<void> updateLocalTranscoderConfiguration( LocalTranscoderConfiguration config);
Details
After calling startLocalVideoTranscoder, call this method if you want to update the local video mixing configuration.
Parameters
- config
- Configuration of the local video mixing, see LocalTranscoderConfiguration.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
updatePreloadChannelToken
Updates the wildcard token for preloading channels.
Future<void> updatePreloadChannelToken(String token);
Details
You need to maintain the life cycle of the wildcard token by yourself. When the token expires, you need to generate a new wildcard token and then call this method to pass in the new token.
Applicable scenarios
In scenarios involving multiple channels, such as switching between different channels, using a wildcard token means users do not need to apply for a new token every time joinning a new channel, which can save users time for switching channels and reduce the pressure on your token server.
Parameters
- token
- The new token.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
updateRtmpTranscoding
Updates the transcoding configuration.
Future<void> updateRtmpTranscoding(LiveTranscoding transcoding);
Details
Agora recommends that you use the server-side Media Push function. For details, see Use RESTful API.
After you start pushing media streams to CDN with transcoding, you can dynamically update the transcoding configuration according to the scenario. The SDK triggers the onTranscodingUpdated callback after the transcoding configuration is updated.
Parameters
- transcoding
-
The transcoding configuration for Media Push. See LiveTranscoding.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
updateScreenCapture
Updates the screen capturing parameters.
Future<void> updateScreenCapture(ScreenCaptureParameters2 captureParams);
Details
- Call this method, and set captureAudio to
true
. - Call updateChannelMediaOptions, and set publishScreenCaptureAudio to
true
to publish the audio captured by the screen.
- This method is for Android and iOS only.
- On the iOS platform, screen sharing is only available on iOS 12.0 and later.
Parameters
- captureParams
- The screen sharing encoding parameters. See ScreenCaptureParameters2.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
updateScreenCaptureParameters
Updates the screen capturing parameters.
Future<void> updateScreenCaptureParameters( ScreenCaptureParameters captureParams);
Details
- This method is for Windows and macOS only.
- Call this method after starting screen sharing or window sharing.
Parameters
- captureParams
- The screen sharing encoding parameters. See ScreenCaptureParameters.Attention: The video properties of the screen sharing stream only need to be set through this parameter, and are unrelated to setVideoEncoderConfiguration.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
updateScreenCaptureRegion
Updates the screen capturing region.
Future<void> updateScreenCaptureRegion(Rectangle regionRect);
Details
Parameters
- regionRect
- The relative location of the screen-share area to the screen or window. If you do not set this parameter, the SDK shares the whole screen or window. See Rectangle. If the specified region overruns the screen or window, the SDK shares only the region within it; if you set width or height as 0, the SDK shares the whole screen or window.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.
setRemoteSubscribeFallbackOption
Sets the fallback option for the subscribed video stream based on the network conditions.
Future<void> setRemoteSubscribeFallbackOption(StreamFallbackOptions option);
Details
An unstable network affects the audio and video quality in a video call or interactive live video streaming. If option is set as streamFallbackOptionVideoStreamLow or streamFallbackOptionAudioOnly, the SDK automatically switches the video from a high-quality stream to a low-quality stream or disables the video when the downlink network conditions cannot support both audio and video to guarantee the quality of the audio. Meanwhile, the SDK continuously monitors network quality and resumes subscribing to audio and video streams when the network quality improves.
When the subscribed video stream falls back to an audio-only stream, or recovers from an audio-only stream to an audio-video stream, the SDK triggers the onRemoteSubscribeFallbackToAudioOnly callback.
Parameters
- option
- Fallback options for the subscribed stream. See StreamFallbackOptions.
Exceptions
When the method call succeeds, there is no return value; when fails, the AgoraRtcException exception is thrown. You need to catch the exception and handle it accordingly.